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ABSTRACT 

A  matrix  S  in  a  solvent  of  the  matrix  polynomial 

M( X )  S  Xm  +  A,Xm_1  +  •••  +  A  , 
l  m 

if  M(S)  *  £,  where  A^,  X  and  S  are  square  matrices.  We 
nresent  some  new  mathematical  results  for  matrix  polynomials, 
as  well  as  a  globally  convergent  algorithm  for  calculating 
such  solvents. 

In  the  theoretical  part  of  this  paper,  existence 
theorems  for  solvents,  a  generalized  division,  interpolation, 
a  block  Vandermonde,  and  a  generalized  Lagrangian  basis  are 
studied. 

Algorithms  are  presented  which  generalize  Traub's 
scalar  polynomial  methods,  Bernoulli's  method,and  eigenvector 
powering. 

The  related  lambda-matrix  problem,  that  of  finding 
a  scalar  X  such  that 

IAm  +  A1 Xm_1  +  •• •  +  Am 
1  m 

is  singular,  is  examined  along  with  the  matrix  polynomial 
problem. 

The  matrix  polynomial  problem  can  be  cast  into  a 
block  eigenvalue  formulation  as  follows.  Given  a  matrix  A  of 
order  mn,  find  a  matrix  X  of  order  n,  such  that  AV  «  VX, 
where  V  is  a  matrix  of  full  rank.  Some  of  the  implications 
of  this  new  block  eigenvalue  formulation  are  considered. 
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Introduction 

In  this  chapter  we  state  the  problem,  give  some  of 
the  definitions,  present  the  major  results  of  the  paper,  and 
outline  the  entire  dissertation. 

1.1  Preliminaries .  Algorithms  for  the  solution  of  the  scalar 
polynomial  problem,  xm  +  a1xm_1  +  •••  +  am  "  0*  have  become 
extremely  efficient.  See  Traub  [20,21]  and  Jenkins  and  Traub 
[7,8].  A  ration  of  the  scalar  polvnomial  Is  given  by 

the  following. 

Definition  1.1  Given  n  b£  n  matrices  Aq,A^, . . . ,Am,  a  matrix 
polynomial  M(X)  is  the  matrix  function 

M(X)  =  A  Xm  +  A_Xm“1  +  •••  +  k  (1.1) 

o  1  m 

in  the  n  by  n  matrix  variable  X. 

If  Aq  is  nonsingular,  then  the  monlc  matrix  polynomial  is 

M(X)  5  A^1M(X).  (1.2) 

Two  generalizations  of  the  roots  of  a  scalar  poly¬ 
nomial  are  to  be  examined.  The  first  one,  the  major  emphasis 
of  this  work,  is  classical.  Little  is  known,  however,  about 
existence  and  calculation  of  such  roots  of  matrix  polynomials. 
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Definition  1.2  A  matrix  Sis  a  solvent  of  the  matrl x  poly¬ 
nomial  M(X)  if 


M(S)  -  0.  (1.3) 

Definition  1.3  A  matrix  W  Is  a  weak  solvent  of  the  matrix 
polynomial  M(X)  if 


det  M(W)  »  0.  (1.4) 

A  special  case  of  the  weak  solvent  problem  is  the 
important  lambda-matrix  problem.  Restricting  the  class  of 
weak  solvents  to  scalar  matrices,  XI,  and  using  the  notation 
M( A )  =  M(XI),  the  lambda-matrix  problem  is  that  of  finding 
a  scalar  X  such  that 

M(A)  -  AoAm  +  A1Xm~1  +  •••  +  Am  (1.5) 

Is  singular.  Such  a  scalar  is  called  a  latent  T,oot  of  M(A) 
and  vectors  b  and  r  are  right  and  left  latent  vectors,  respec¬ 
tively,  if,  for  a  latent  root  p,  M(p)b  *  0  and  rTM(p)  *  0T. 
M( X )  in  equation  (1.5)  is  an  n  by  n  matrix  whose  elements  are 
scalar  polynomials  in  X.  See  Lancaster  [ 1 3 3 »  Gantmacher  [2], 
MacDuffee  [15],  and  Peters  and  Wilkinson  [17]  for  a  complete 
discussion  of  lambda-matrices.  A  description  of  some  of  the 
present  methods  of  solving  the  lambda-matrix  problem  Is  found 
in  Appendix  B. 
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Only  monlc  matrix  polynomials  are  studied  in  ♦'he 
main  part  of  this  dissertation*  The  case  of  tne  nonmonic 
matrix  polynomial,  and  where  Aq  is  singular,  will  be  consid¬ 
ered  in  Appendix  A.  If  AQ  is  nonsingular,  the  monic  matrix 
polynomial  M(X)  can  be  obtained  by  the  solution  of  several 
linear  systems,  as  was  suggested  by  Peters  and  Wilkinson  [17]. 
Hence,  we  consider 

M(X )  =  Xm  +  +  •••  +  Affl.  (1.6) 

The  following  are  some  well-known  results  that  will 
be  frequently  used.  They  may  all  be  found  in  Lancaster  [13]. 

A  corollary  of  Bezout's  theorem  states  that  if  S  is 
a  solvent  of  M(X)  then 

M(A)  =  Q(A)(IA-S),  (1.7) 

where  Q(A)  is  a  monic  lambda-matrix  of  degree  m-1.  Another 
result  is  that  the  lambda-matrix  M(A)  has  mn  latent  roots, 
and  hence,  it  follows  immediately  from  (1.7)  that  the  n 
eigenvalues  of  a  solvent  are  all  latent  roots  of  the  lambda- 
matrix.  Furthermore,  the  n(m-l)  latent  roots  of  Q(A)  are 
also  latent  roots  of  M(A). 

If  one  is  interested  in  the  solution  of  a  lambda- 
matrix  problem,  then  a  solvent  will  provide  n  latent  roots 
and  can  be  used  for  a  matrix  deflation,  which  yields  the  new 
problem  Q( A ) . 
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1.2  M.‘>  1  n  jV_au_ !  Iv’l  OT  UlliJ,  *  Th«  following  a r*»  t  hr*  prin¬ 

cipal  results  of  thin  work.  They  will  he  proved  In  later 
chap  tern . 

The  Fundaments  1  Theorem  of  A!  grh ra ,  that  a  scalar 
polynomial  has  at  least  one  zero,  does  not  hold  true  for 
matrix  polynomials.  There  are  matrix  polynomials  which  have 
no  solvents  (Theorem  2,6). 

It  la  useful  to  have  a  concept  of  a  matrix  poly¬ 
nomial  with  a  complete  set  of  solvents.  This  la  a  generali¬ 
zation  of  an  nth  degree  scalar  polynomial  having  n  roots. 

Definition  1 . 4  A  set  of  m  solvents  of  M(X)  la.  a  complete  set 
of  solvents ,  if  the  set  of  mn  eigenvalues  of  the  m  solvents 
la  the  same,  oountlng  multlpllol ties .  as  the  set  of  mn  latent 
roots  of  M( \) . 

Thu3,  In  the  special  case  of  M(X)  having  mn  dis¬ 
tinct  latent  roots,  a  complete  set  of  m  solvents  must  have 
no  common  eigenvalues  and  each  solvent  must  have  distinct 
eigenvalues . 

We  consider  a  generalization  of  the  scalar 
Vandermonde  matrix. 

Definition  1.5  Given  n  n  matrices  ,  • • • ,Sm>  the  b lock 
Vandermonde  matrix  i3 


M 


V  ( ft 


l  * 


•V 


M 


TO-  1 


,.m-  l 

''  % 

► 


ro 


:im" 1 
II) 


( t ,  ft) 


tt  will  b«  ahown  In  Chaptwr  *»  that,  U  i«  not,  suffi¬ 
cient  that,  matrloea  have  distinct  and  disjoint 

eigenvalues  for  V(S*  ,• • • ,8_)  to  ba  nonaingu lar . 

4  m 

Nxiatenoe  of  a  complete  aat  of  solvents  for  the 
Important,  special  case  of  the  lambda-matrix  having  distinct 
latent  roota  la  given  by  the  following  theorem  (Theorem  U.i). 


Theorem  U  M(X)  U«1  AUUnSfc  Eag&jgL»  than  M(X)  U&a  a 

complete  aat  of  aolventp  ,  ai*'**»sm»  V(Sj  , •  •  •  ,Sm)  la  non- 

Pefinitlon  1.6  A  aolvent  of  M(X)  la_  a  dominant  solvent  If 
the  n  eigenvalues  of  this  aolvent  are  strictly  the  n  largest 
latent  roota  of  M(.\) . 

Algorithm  1,  presented  below  and  again  in  Chapter  5, 
attempts  to  find  a  dominant  aolvent  of  M(X).  It  is  a  gener¬ 
alization  of  one  due  to  Traub  [21]  for  scalar  polynomials. 

The  algorithm  has  two  stages.  The  first,  a  generalization  of 
Sebastiao  e  Silva’s  algorithm  (see  Householder  [*0),  generates 
a  sequence  of  matrix  polynomials,  all  of  degree  less  than  m. 
Then  the  last  two  matrix  polynomials  of  the  generated 


sequence  are  uae«t  In  a  matrix  Iteration  which  In  to  converge 
to  a  dominant  solvent. 

Algorithm  l 

(O  *y*>  -  i  and 

Qn+.l(X>  "  VX)X  “  aiM<x>*  (1.9) 

£2H  n  •  0,1, •••  .1.-1,  wh«r? 

Qn(X)  ■  ajxn'"1  ♦  •••  ♦  ajj.  (1.10) 

(ii)  I**!  X0  •(ai)(«i‘1)  find 

Xl.)  ‘  °L(ltl)0Z-lCXl>  (1-U) 

for  1  ■  0 ,1, • • 4 . 

Convergeno©  of  this  algorithm  is  established  for  a 
class  of  matrix  polynomials  (Theorem  5.1). 

Theorem  If 

(1)  M(X)  has  a  oomplete  set  of  solvents .  S1, » •  »,Sm, 

(ii)  S.^  is.  a  dominant  solvent .  and , 

(iii)  V(S1,».»tS  )  and  V(S2>  •  •*,Sm)  are  nonslngular , 
then 

(1)  0  (X)  =  (a”)  Qn(X)  M  n  °°»  where 
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HjU)  la  Ills,  unlgur  monlo  matrix  polynomial  or 
degree  m- .1  with  golygnta  S ? ,  •  •  •  , r. |() ,  but  not  -1  ^  ,  and 
(it)  for  I,  sufficiently  largo  of  equation  (1.11)  con¬ 
verges  to 

It  will  be  shown  (Corollary  $.2  and  Lemma  ‘3.7)  that 
each  stage  of  the  algorithm  la  linearly  convergent.  Let  o  be 
the  absolute  value  of  the  ratio  of  the  smallest  eigenvalue  of 
S1  and  the  largest  remaining  latent  root  of  M(X).  Then  the 
asymptotic  error  constants  of  the  first  and  second  stage  are 
OjO  and  a2aL-1,  respectively,  where  a  <  1  and  L  Is  the  num¬ 
ber  of  iterations  of  the  first  stage  before  switching  to  the 
second  stage.  Thus,  the  second  stage,  though  linearly  con¬ 
vergent,  can  be  made  arbitrarily  fast  by  increasing  the  num¬ 
ber  of  Iterations  of  the  first  stage.  In  the  computational 
algorithm,  we  pick  an  arbitrary  L  and  then  examine  the  second 
stage.  If  it  is  converging  too  slowly  (or  diverging),  then 
the  first  stage  is  resumed  for  several  steps  and  the  process 
Is  continued.  Thus,  given  that  the  three  hypotheses  of  the 
above  theorem  are  satisfied,  this  process,  in  exact  arithmetic, 
is  guaranteed  to  yield  a  solvent  of  the  matrix  polynomial. 

If  a  dominant  solvent  does  not  exist,  then  the  algo¬ 
rithm  will  not  yield  a  solvent.  In  addition  to  the  results  in 
the  above  theorem,  the  first  stage  yields  a  dominant  latent 
root.  If  one  exists.  Consider  the  following  algorithm  which 
obtains  a  dominant  latent  root  (Chapter  7). 
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Deflnltlon  1.7  Given  vectors  v0»vi*****vm  ?£  dimension  n,  a 
lambda- vector  g(A)  is.  the  vector  function 

g( A ,  s  v0Anj  +  v1A,n“1  +  •••  +  vm.  (1.12) 

Algorithm  2  Let  gQ(X)  be  an  arbitrary  m-1  degree  lambda- 
vector.  Generate 


gn+l<X)  “  «„<x>x  -  M(X)v[n),  (1.13) 

where 

g„(X)  =  v[n^Xm'jl  +  •••  +  v<“).  (1.14) 

This  is  another  generalization  of  Traub's  scalar 
polynomial  algorithm.  For  a  vector  v,  denote  by  max  v  the 
first  element  of  v  which  has  the  maximum  absolute  value. 

Note  that  max  v  is  not  a  norm.  Then  a  convergence  theorem 
for  the  algorithm  Is  as  follows  (Theorem  7*1) • 

Theorem  I£ 

(i)  m( x)  jiaa.  diatlnaL  i&ksnk  pl,'”,pmn, 

(11)  IpJ  >  I  p  1|  for  1*1,  and 

(ill)  riK0^Pi)  *  °i  where  r^M(p1)  -  0T, 
then 

(1)  inU)  -  — ~ — H7T  ""  T^~l~  bi»  where  M( p, )b,  -  0 

n  max  v[n;  A  P1  1  1  1 
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and 


(ID 


v 


(n+1) 


"  °lvl 


(n) 


max  v 


r?rr 


0. 


(1.15) 


The  transpose  of  any  column  of  equation  (1.9)  with 

T 

X  -  XI,  is  precisely  equation  (1.13),  with  M  (X)  replacing 

T 

M(X).  Since  the  latent  roots  of  M  (X)  are  the  same  as  those 
of  M(X),  a  dominant  latent  root  of  M(X)  can  be  obtained  from 
equation  (1.15)  by  Algorithm  1,  the  matrix  polynomial  solvent 
algorithm.  This  can  be  done  regardless  of  whether  a  dominant 
solvent,  or  any  solvent  at  all,  exists. 

1.3  Outline  of  the  Remainder  of  the  Paper.  This  paper  con¬ 
tains  three  intertwined  yet  distinct  subjects.  They  are 
(i)  new  theoretical  results  on  matrix  polynomials, 

(il)  algorithms  for  solvents  and  latent  roots,  and 
(ill)  a  new  block  eigenvalue  problem. 

Chapter  2  considers  the  basic  properties  of  sol¬ 
vents.  The  existence  of  solvents  and  factorization  of  lambda- 
matrices  are  considered  here.  A  generalization  of  B^zout's 
Theorem  and  the  relationship  between  polynomial  coefficients 
and  the  elementary  symmetric  functions  are  also  discussed. 

In  Chapter  3  we  present  some  of  the  basic  proper¬ 
ties  of  matrix  polynomials.  Interpolation,  representation 
theorems  and  fundamental  matrix  polynomials  are  presented  in 
this  chapter. 
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Properties  of  the  block  Vandermonde  matrix  are  given 
In  Chapter  M. 

The  second  major  area  of  this  dissertation  concerns 
Itself  with  algorithms  for  finding  solvents  and  latent  roots. 
Chapter  5  presents  Algorithm  1,  the  main  algorithm  of  the 
paper.  The  method  finds  solvents  and  is  a  generalization  of 
Traub's  scalar  polynomial  methods  [21].  A  convergence 
theorem,  computational  discussion  and  flow-chart  are  given 
here . 

A  block  Bernoulli  method  is  described  in  Chapter  6. 
The  relation  between  this  method  and  Algorithm  1  is  discussed. 

In  Chapter  7  we  present  Algorithm  2,  which  finds  a 
dominant  latent  root.  The  key  result  is  given  -  the  computa¬ 
tions  of  Algorithm  2  are  done  by  Algorithm  1.  A  vector 
Bernoulli  method  is  also  described. 

The  third  area  of  this  work  is  a  new  block  eigen¬ 
value  problem.  It  is  that  of  finding  a  matrix  X  of  order  n 
such  that  for  given  matrix  A  of  order  mn,  the  equation 
AV  »  VX  is  satisfied  for  a  matrix  V  of  full  rank.  Chapter  3 
deals  with  this  problem.  It  is  shown  that  when  A  is  the 
block  companion  matrix,  this  problem  is  a  generalization  of 
the  matrix  polynomial  solvent  problem.  A  general  theory  of 
block  eigenvalues  as  well  as  two  algorithms  based  on  eigen¬ 
vector  powering  are  offered. 

Chapter  9  describes  numerical  testing  of  Algorithms 


1  and  2. 


CHAPTER  2 


Solvents 

•In  this  chapter  we  study  3ome  of  the  properties  of 
solvents.  Section  2.1  considers  a  division  of  matrix  poly¬ 
nomials  which  results  in  a  new  derivation  and  generalization 
of  B^zout's  theorem.  Section  2.2  examines  the  block  compan¬ 
ion  matrix.  Principal  vectors  of  solvents  are  considered  in 
Section  2.3.  The  existence  of  solvents  and  factorization  of 
lambda-matrices  are  both  dealt  with  in  Section  2.4. 

2.1  Generalized  Division.  The  class  of  matrix  polynomials 

is  not  closed  under  multiplication  or  division.  Consider  the 

product  of  N(X)  =  X  +  N  and  L(X)  s  X  +  L.  We  get 

N(X)L(X)  -  (X+N) (X+L)  -  X2  +  NX  +  XL  +  NL  which  is  not  of 

2 

the  general  %form  of  a  matrix  polynomial;  X  +  A-^X  +  A^.  A 
new  operation  will  be  defined  for  matrix  polynomials  which 
will  reduce  to  division  in  the  scalar  case;  n  -  1. 

Theorem  2.1  Let  M(X)  -  Xm  +  AiXm“1  +  • • •  +  Am  M 
W(X)  *  Xp  +  D1XP_1  +  •••  +  Bp ,  with  m  >.  p.  Then  there 
exists  a  unique »  monlc  matrix  polynomial  F(X)  of  degree  m-p 
and  a  unique  matrix  polynomial  L(X)  of  degree  p-1  such  that 

M( X)  =  F(X)XP  +  B1F(X)XP_1  +  •••  +  BpF(X)  +  L(X).  (2.1) 

Proof:  Let  F(X)  -  Xm”p  +  F1Xm_?"]  +  •••  +  F  and 
L(X)  -  LqXP_1  «•  L1XP_2  +  •••  +  Lp_1.  Equating 


11 


12 


coefficients  of  equation  (2.1),  >F2 » *  *  * >Fm~p  and 

Lq,L1, • • • ,Lp_^  can  be  successively  and  uniquely 
determined  from  the  m  equations.  ff 

Equation  (2.1)  is  the  matrix  polynomial  division  of 
M(X)  by  W(X)  with  quotient  F(X)  and  remainder  L(X) . 

Definition  2.1  Associated  with  the  matrix  polynomial , 

M(X)  =  Xm  +  A-.X111’"1  +  •••  +  A  ,  is  the  commuted  matrix  poly- 
1  m  —  - - -  * - — 

nomial 


$(X)  =  xm  +  x"1'2^.,  +  •••  +  A.  (2.2) 

1  m 

If  M(R)  «*  _Q_,  then  R  Is  a  left  solvent  of  M(X)  . 

The  matrix  S  such  that  M(S)  -  previously  Just 
called  a  solvent,  will  be  referred  to  as  a  right  solvent  when 
confusion  might  occur. 

An  Important  association  between  the  remainder, 

L(X) ,  and  the  dividend,  M(X),  in  equation  (2.1),  will  now  be 
given.  It  generalizes  the  fact  that  for  scalar  polynomials 
the  dividend  and  remainder  are  equal  when  evaluated  at  the 
roots  of  the  divisor. 

Corollary  2.1  If  R  is  a  left  solvent  of  W(X)  ,  then 
L( R)  »  M(R). 

Proof:  Let  Q(X)  ■  M(X)  -  L(X).  Then,  it  la  easily  shown 

that 

Q(X)  I  Xm"PW(X)  +  Xm'P“1w(X)F1  ♦  ...  +  tf(X)Fm_p.  (2.3) 
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The  result  Immediately  follows  since  Q(R)  =  £  for 
all  left  solvents  of  W(X).  § 

The  case  where  p  =  1  is  very  useful  in  this  paper. 
Here  we  have  W(X)  *  X  -  R  where  R  is  both  a  left  and  right 
solvent  of  W(X).  Then  Theorem  2.1  shows  that 

M(X)  -  F(X)X  -  RF(X)  +  L  (2.4) 

where  L  is  a  constant  matrix.  Now  Corollary  2.1  shows  that 

A 

L  «=  M(R) ,  and,  thus  , 


M(X)  =  F(X)X  -  RF( X)  +  M(R).  (2.5) 


There  is  a  corresponding  theory  for  M(X) .  In  this 
case,  equation  (2.1)  is  replaced  by 

M(X)  =  XPH(X)  +  XP”1H(X)B1  +  •••  +  H(X)Bp  +  N(X)  (2.6) 


and  Corollary  2.1  becomes  the  following. 

Corollary  2.2  If  S  is  a  right  solvent  of  W(X),  then 
N(S)  -  1(3). 

We  again  consider  the  case  of  p  ■  1.  Let 
W(X)  *  X  -  S.  Then  equation  (2.5)  becomes 

M(X)  5  XH(X)  -  H(X)S  +  M (S).  (2.7) 


Restricting  X  to  a  scalar  matrix  XI,  and  noting  that 
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M(A)  =  M(A),  we  get  B^zout's  Theorem  (see  Gantmacher  [2, 
vol.  I,  p.  8l])  from  equations  (2.5)  and  (2.7): 

M( A )  =  (IA-R)P(A)  +  M(R)  i  H(A)(IA-S)  +  M(S)  (2.8) 

for  any  matrices  R  and  S.  If  in  addition  R  and  S  are  left 
and  right  solvents,  respectively,  of  M(X),  then 

M( X )  =  F(X)X  -  RF ( X ) ,  (2.9) 

M(X)  =  XH( X)  -  H(X)S  (2.10) 

and 

M( A)  =  (IA-R)F(A)  =  H( A) (IA-S).  (2.11) 

Hence,  Corollaries  2.1  and  2.2  are  generalizations  of 
Bezout's  Theorem. 

The  use  of  block  matrices  is  fundamental  In  this 
work.  For  notational  purposes  it  is  useful  to  have  a  concept 
of  the  transpose  of  a  block  matrix  without  transposing  the 
blocks . 

Definition  2.2  Let  A  be  a  matrix  with  block  structure  < j ) 
with  B^j  matrices  of  order  n.  The  block  transpose  of  dimen¬ 
sion  n  of  A ,  denoted  A8  ^ n  ^ ,  is.  the  matrix  with  block  struc¬ 
ture  (B^) . 

The  order  of  the  block  transpose  will  generally  be 

B(n) 

dropped  when  it  is  clear.  Note  that,  in  general,  A  i*  A  , 
except  when  n  *  1. 

A  scalar  polynomial  exactly  divides  another  scalar 
polynomial,  if  all  the  roots  of  the  divisor  are  roots  of  the 


dividend.  A  generalization  of  the  scalar  polynomial  result 
is  given  next.  The  notation  is  that  of  Theorem  2.1. 

Corollary  2.3  If  W(X)  has  p  left  solvents,  R,  , • • • ,R_  which 
"  "  - - -  i  P  - 

are  also  left  solvents  of  M(X) ,  and  if  VB(R1 , • • • ,Rp)  is  non- 
singular,  then  the  remainder  L(X)  = 

Proof:  Corollary  2.1  shows  that  £(R^)  =*0  for 

l  a  l,***,p.  Since  VB(R^,**»,R  )  is  nonsingular, 
and  since 

£-0^) 
fi(R2) 

9 

m 

L(Rp) 

it  follows  that  L(X)  =  £.  Thus, 

M(X)  =  F(X)XP  +  B,F(X)XP"1  +  •••  +  B  F(X).  H  (2.12) 

1  P 

From  equation  (2.11)  it  follows  that  the  eigen¬ 
values  of  any  solvent  (left  or  right)  of  M(X)  are  latent 
roots  of  M(X).  These  equations  allow  us  to  think  of  right 
(left)  solvents  of  M(X)  as  right  (left)  factors  of  M(X). 

In  the  scalar  polynomial  case,  due  to  commutivity, 
right  and  left  factors  are  equivalent.  Relations  between 
left  and  right  solvents  can  now  be  given. 


•  U\  .. 


CoDllury  It’  S  ^  nndll,  are  tMjfht  left  nol.Yimla  »t' 

M(  x)  ,  :V-VLr'-X^i  •  r'tu>  ’>  ^  mill  Hj  [ijWjn  (jo  common  n  l  g»mva  Inn:*  , 

yi'MI  PjtSj)  -  0,  Wh«*lV  Kj(X^  )ti  K(X)  itnt't  Ill'll  l>y  equal  toq 

0.9)  with  H  «  1{  . 

Proof:  Equation  (2.9)  allows  that; 

P1(Sj)Mj  -  HiK1(Sj)  -  &.  (2.  1.1) 

Since  Sj  and  H ^  have  no  common  elnenvnhmn, 

P .  C  S  4 )  *  uniquely.  This  follows,  alnor*  the 
solution  of  AX  *  X,B  has  the  unique  aolut Jon 
X  "  0,  If  and  only  If  A  and  B  have  no  common 
eigenvalues.  See  Gantmacher  [2*  p.  215'].  # 

Given  a  left  solvent  R.  of  M(X),  Theorem  2.1  shows 
that  P± C X)  exists  uniquely.  If  S  la  a  right  solvent  of  M(X) 
and  If  ( S)  is  nonsingular  (S  is  not  a  weak  solvent  of  p^x)), 
then  equation  (2.13)  shows  that 

Rt  -  P1(S)SPj1(S).  (2.1>l) 

This  gives  an  association  between  left  and  right  solvents. 

2.2  Companion  Matrix .  A  useful  tool  in  the  study  of 

scalar  polynomials  is  the  companion  matrix.  The  eigenvalues 
of  a  companion  matrix  are  the  roots  of  Its  associated  poly¬ 
nomial.  See  Wilkinson  [22,  p.  12].  A  generalisation  of  this 
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Is  given  below.  Definition  2.3»  Theorem  2.2  and  Corollary 
2.5  can  be  found  in  Lancaster  [133. 

Definition  2.3  Given  a  matrix  polynomial 

j 

M(X)  S  X®  +  A-X™"1  +  •••  +  A  , 
x  rn 


the  block  companion  matrix  associated  with  it  is 


C 


(2.15) 


It  is  well  known  that  the  eigenvalues  of  the  block 
companion  matrix  are  latent  roots  of  the  associated  lambda- 
matrix.  See  Wilkinson  [22,  p.  12].  Simple  algebraic  manipu¬ 
lation  yields  this  result. 

Theorem  2.2  Det(C-XI)  =  (-l)randet(lXm+A1Xm"1+* • *+Am). 

Since  C  is  an  mn  by  mn  matrix,  we  immediately  ob¬ 
tain  the  following. 

Corollary  2.5  M(X)  ha3  exactly  mn  finite  latent  roots . 

The  form  of  the  block  companion  matrix  could  have 


been  chosen  differently.  Theorem  2.2  also  holds  for  the 
block  transpose  of  the  companion  matrix: 


18 


0 


I 


-A 


ra-1 


\ 


I 


(2.16) 


The  algorithms  given  In  this  paper  are  b'tred  on 
eigenvector  powering  schemes.  It  will  be  useful  to  know  the 
eigenvectors  of  the  block  companion  matrix  and  its  block 
transpose.  The  results  are  a  direct  generalization  of  the 
scalar  case. 


Theorem  2.3  1§.  a  latent  root  of  M(X)  and  and  are 

right  and  left  latent  vectors .  then  PA  Is,  an  eigenvalue  of  C 

n 

and  of  C  and 


(1) 


(,ibi 


-111—1. 

Pi  b±. 


B 


Is  the  right  eigenvector  of  C  , 


(11) 


piri 


Is  the  left  eigenvector  of  C,  and 
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(Hi) 


J1 

‘.l 


Is  the  right  eigenvector  of  C ,  where 


M(  A)b 


y— -p^  s  b1Am“1  +  b^A™”2  +  •••  +  (2.17) 


Proof:  Parts  (1)  and  (11)  are  easily  verified  by  substi¬ 
tutions  into  the  appropriate  eigenvalue  problem. 
For  part  (ill),  consider 


< 

1 

o 

• 

• 

• 

o 

d(m-l)| 

LCm-l) 

m 

i 

1 

I  -A  , 

• 

• 

• 

• 

m-1 

• 

• 

*  «  • 

d(  ^ 

"  P1 

dJD 

•  • 

1 

i 

T  -Ai  , 

d(°) 

[d<°>  1 

(2.18) 

Multiply  out;  multiply  the  J  component  equation 
by  A^~^;  and  add.  The  result  is 

H1(A)A  -  M(A)d[0)  =  piH1(X),  (2.19) 


where 


a^0)xm_1, 


Hjtx)  =  d^"1-1'  +  d^m~2'x  + 


•  •  • 


(2.20) 
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Equation  (2.19)  at  \  ■  shews  that 

M(Pi)d^0^  *  0  and,  hence,  is  a  right  latent 

vector.  Manipulating  equation  (2.19),  the  result 

equation  (2.17)  with  dj0^  *  and  d^  ^ 

for  J  *  l,***,m-l,  follows.  # 

2.3  Structure  of  Solvents .  The  eigenvectors  and  principal 
vectors  of  a  solvent  will  now  be  considered.  Prom  equation 
(2.11)  it  follows  that  the  eigenvectors  of  a  left  (right) 
solvent  are  left  (right)  latent  vectors  of  the  lambda-matrix. 
Lancaster  [13,  p.  50]  gives  the  characterization  of  a  solvent 
that  has  only  elementary  divisors. 

Theorem  2.4  If  M(A)  has  n  linearly  Independent  right  latent 
vectors  ,  b^,*  •  •  ,bn,  corresponding  to  latent  roots  p^,*  *  ’  »pn> 
then  QAQ-1  is^  a  right  solvent,  where  Q  *  [b1, . . .  ,bn]  and 
A  -  diag(p1, . . . ,pn) . 

Proof:  From  M(QAQ_1)  »  (qa'h+AjQA®"'3^*  •  •♦A^Q-1  the 

result  follows,  since  QAm  +  A^QA™  1  +  •••  +  AmQ 
is  just  M(p1)b1  =  0  for  i  =  1, • • • ,n .  # 

It  follows  from  the  above  proof  that  if  a  solvent 
is  diagonalizab le ,  then  it  must  be  the  form  QAQ-1,  as  In  the 
above  theorem. 

Corollary  2.6  If  M(A)  has  mn  distinct  latent  roots ,  and  the 
set  of  right  latent  vectors  satisfy  the  Haar  condition  ( that 
every  set  of  n  of  them  are  linearly  Independent) ,  then  there 
are  exactly  different  right  solvents . 
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Consider  next  the  case  of  a  solvent  which  is  not 
d!  up.onal  1  zable .  In  a  manner  similar  to  Roth  [18],  we  con¬ 
sider  the  principal  vectors  of  a  solvent. 

Definition  2.4  The  principal  latent  vectors  of  M(X)  with 
respect  to  the  latent  root  p  Is  Pj,  which  satisfies 


TFT77  «(J-?)(P)P2  -  •••  +  M(p)Pj  =  0, 

(2.21) 

where 

M(k)(X)  -  ^  M(X). 
dXK 

Note  that  the  first  principal  latent  vector  is  a  latent 
vector. 


Theorem  2.5  The  principal  vectors  of  a  solvent  are  principal 
latent  vectors  of  M(X). 


Proof:  To  alleviate  notational  difficulties,  consider  the 
case  where  m  **  2  and  n  ■  k  ■  3-  The  Jordan 


form  of  the  solvent  Is  J 


Let 


P  a  (P^P^P^)  where  S  ■  PJP"^  is  the  solvent 
of  M(X)  -  X2  +  AjX  +  A2.  Thus 


I 
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£  =  M(S)P  -  [(P-^P^J2  +  Ai(PiP2P3)J  +  a2(P1P2P3)] 

*  [(lp2+A1p+A2)pi>(2Ip+A1)P1  +  (lp2+A1p+A2)p2>IP1 

+  (2Ip+A1)P2  +  (lp2+A1P+A2)P3J 

*  [m(p)p1,m,(p)p1 

+  M(p)P2,  \  M"(p)P1  +  M'(P)P2  +  M(  p )  P  3  j| . 

Hence,  P^,  P2  and  P  ,  the  principal  vectors  of  S, 
satisfy  equation  (2.21),  the  definition  of  prin¬ 
cipal  latent  vectors.  § 

It  is  the  strategy  of  this  paper  to  solve  the 
lambda-matrix  problem  by  finding  solvents  and  then  finding 
the  eigenvalues  of  those  solvents.  The  calculation  of  sol¬ 
vents  from  the  solution  of  the  latent  root  problem  has  been 
considered  in  the  literature.  The  following  is  a  short 
description  of  the  method. 

Since  the  eigenvalues  of  a  solvent  are  latent  roots 
of  the  lambda-matrix,  and  there  are  mn  latent  roots.  It  fol¬ 
lows  that  there  are  only  a  finite  number  of  Jordan  forms  of 
potential  solvents.  Let  the  latent  roots  be  given  and  let  J 
be  a  matrix  in  Jordan  form  with  n  of  the  latent  roots  as  its 
eigenvalues.  Then,  to  find  a  corresponding  solvent  S,  if 

one  exists,  a  nonsingular  matrix  P  must  be  found  such  that 
__  1 

M(PJP  )  »  £.  Thus,  a  nonsingular  matrix  P  must  be  found 


such  that 
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PJm  +  A-jPJ"1"1  +  •**  +  AmP  »  £.  (2.22) 

This  approach,  described  in  MacDuffee  [15,  p.  95],  is  of  the 
general  form 

A-XB..  +  A0XB0  +  •••  +  AXB  -  C.  (2.23) 

112  2  mm 

Lancaster  [11]  and  Gantmacher  [2]  have  considered  the  solu¬ 
tion  of  equation  (2.23)*  The  problem  is  difficult  numerically. 

Algorithm  1  tries  to  find  a  solvent  directly, 
rather  than  by  the  above  route  of  solving  the  latent  root 
problem  first. 

2.M  Existence  of  Solvents.  We  now  show  that  the  Fundamental 
Theorem  of  Algebra  does  not  hold  for  matrix  polynomials. 

Theorem  2.6  There  exists  a  matrix  polynomial  with  no  sol¬ 
vents  . 

Proof:  Consider 


(2.21*) 


Det  M(^)  *  X^  -  4X^  +  6X^  - 
four  roots  at  X  ■  1.  Thus, 

solvent  must  either  be  a 


4X  +  l,  which  has  all 
the  Jordan  form  of  a 


2*4  - 


Since  M( I )  y*  0,  it  follows  that  J 2  is  the  only 


feasible  Jordan  form. 


T 

b  =  (1,-1)  is  the  only  latent  vector,  to  within 
a  scalar  multiple.  The  second  principal  vector 
is  such  that  M'(l)b  +  M(1)P2  =  0.  Here, 

/ 2X-2  0  \ 

M'(A)  «  I  j  and,  hence,  M'(l)  =  0. 

\  0  21-2/ 


Thus,  P2  =  b  to  within  a  scalar  multiple.  Using 
Theorem  2.5  and  the  linear  dependence  of  the  first 
two  principal  latent  vectors,  it  follows  that  J2  is 
not  a  feasible  Jordan  form  for  a  solvent  of  equa¬ 
tion  ( 2. 2*0  .  # 


Consider  now  the  special  case  of  a  matrix  polynomial  whose 
associated  lambda-matrix  has  distinct  latent  roots.  It  will 
be  shown  that  in  this  case  a  complete  set  of  solvents  always 
exists.  First  we  need  the  following  fact  about  block  matrices 

Lemma  2.1  If  a  matrix  A  is_  nonslngular ,  then  there  exists  a 

fk  11  ^12\ 

permutation  of  the  columns  of  A  t£  A  such  that  A  =  (  _  J. 

\  21  k22/ 

with  A11  and  A22  nonsingular . 

Proof:  Let  A  and  A^  be  matrices  of  orders  n  and  k,  re¬ 

spectively,  with  arbitrary  1  <  k  <  n.  Assume  the 
lemma  is  false.  Consider  evaluating  the  deter¬ 
minant  as  follows.  For  each  of  the  first  k  rows, 
pick  an  element  from  a  different  column.  Then 
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multiply  these  elements  and  the  remaining  minor. 

The  sum,  with  appropriate  signs,  of  every  possible 
choice  of  the  k  columns,  is  the  determinant  of  A. 
The  k  choices  of  the  columns  determine  a  square 
matrix.  If  that  matrix  is  nonsingular,  then  the 
minor  must  be  zero,  since  the  lemma  was  assumed 
false.  Thus,  such  terms  make  no  contribution  to 
the  determinant  of  A.  A  particular  minor  appears 
several  times  in  the  sum.  It  occurs  the  number 
of  ways  the  same  k  columns  can  be  picked  in  dif¬ 
ferent  orders.  Each  minor  can  thus  be  factored 
from  several  terms;  the  result  being  the  minor 
times  the  determinant  of  the  matrix  formed  by  the 
k  columns  and  the  first  k  rows.  Thus,  if  the 
matrix  formed  by  the  k  columns  is  singular,  then 
there  is  no  contribution  from  this  term  in  the 
determinant  of  A.  Therefore,  A  must  be  singular, 
which  is  a  contradiction.  # 

Once  the  columns  of  A  are  pertoutated  to  get  and 

A^  nonsingular,  the  process  can  be  continued  to  similarly 
divide  Ap2  into  nonsingular  blocks  without  destroying  the 
nonsingularity  of  A-^. 

Theorem  2.7  I_f  A ,  a  matrix  of  order  mn,  i_s  nonsingular ,  then 
there  exists  a  permutation  of  the  columns  of  A  t£  A  «  ( B 1 ^ )  , 
with  a  matrix  of  order  n,  such  that  ijj  nonsingular 

for  1  -  1 , • • * ,m. 


The  important  existence  theorem  is  now  given. 


Theorem  2.8  If  the  latent  roots  of  M(X)  are  distinct .  then 
M(X)  has  a  complete  set  of  solvents . 


Proof:  If  the  latent  roots  of  M(X)  are  distinct,  then  the 
eigenvalues  of  the  block  companion  matrix  are  dis¬ 
tinct,  and,  hence,  the  eigenvectors  of  the  block 
companion  matrix  are  linearly  independent.  From 


b 


i 


Theorem  2.3  the  set  of  vectors 


pibi 


for 


g 

for  i  *  l,***,mn  are  eigenvectors  of  C  .  The 
matrix  whose  columns  are  these  mn  vectors  is  non¬ 
singular.  Theorem  2.7  shows  that  there  are  m  dis¬ 
joint  sets  of  n  linearly  independent  vectors  b^ 
Using  the  structure  QAQ-1  of  Theorem  2.4,  the  com¬ 
plete  set  of  solvents  can  be  formed.  # 


Corollary  2.7  If  M(X)  has  distinct  latent  roots ,  then  it  can 
be  factored  into  the  product  of  linear  lambda-matrices . 


Proof:  Since  M(X)  has  distinct  latent  roots,  there  exists 
a  right  solvent  S  and  M(X)  -  Q( X ) ( I X— S ) .  Q(X)  has 
the  remaining  latent  roots  of  M(X)  as  its  latent 
roots.  It  follows  then,  that  the  latent  roots  of 
Q(X)  are  distinct.  Thus,  the  process  can  be  con¬ 
tinued  until  the  last  quotient  is  linear.  0 
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The  process  described  in  the  above  proof  considers 
solvents  of  the  sequence  of  lambda-matrices  formed  by  the 
division  M(X)  -  Q(X)(IX-S). 

Definition  2.5  A  sequence  of  matrices  form  a  chain 

of  solvents  of  M(X)  if  0^  is.  a  right  solvent  of  Q^X)  ,  where 
Qm(X)  =  M(X)  and 


Q±C  X)  ~  Q1_1(X)(IX-C1) .  (2.25) 

It  should  be  noted  that,  in  general,  only  Cm  is  a 
right  solvent  of  M(X).  Furthermore,  is  a  left  solvent  of 
M(X) .  An  equivalent  definition  of  a  chain  of  solvents  could 
be  defined  with  ,  a  left  solvent  of  T^(X) ,  and 

T^X)  =  (IX-Cm-1+1)T1-1(X).  (2.26) 

Corollary  2.8  I£  M(X)  has  distinct  latent  roots ,  then  M(X) 
has  a  chain  of  solvents . 

Given  ^  and  Qi(X),  Qi_1(X)  of  equation  (2.25)  can 
be  found  by  a  generalized  Horner  division  scheme.  In  the 
numerical  solution  of  the  lambda-matrix  problem,  the  strategy 
considered  here  will  be  to  find  a  chain  of  solvents  using  the 
matrix  polynomial  solvent  algorithm  and  Horner  division. 

If  form  a  chain  of  solvents  of  M(X),  then 

l  m 

M(  A )  i  IXm  +A1Xm"1  +  •••  +Am  5  (IX-C1)(IX-C2)'--(IX-Cjn)  . 

(2.27) 
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This  leads  to  a  generalisation  of  the  da#*  leal  result  foi' 
aoalar  polynomial  whioh  relate*  ooeffioientn  to  elementary 
symmetric  functions.  By  equating  ooeffioientn  of  equation 
(2.27)  one  gets  tho  following  theorem. 

Theorem  2.9  II  ci»*“'cm  4  ^  lift 

M( X)  -  X*  +  A^Xm-1  +  •••  ♦  Am,  1U1H 

A1  •  -<cl+C2+***+Cm) 

A2  •  (C1C2^C1C3+*‘ •+0m^1Cm)  (2.28) 

e 


Am  .  (-n'"c1e!!‘"CB. 


OHArtKR  j 

ittmriltA  s£  ttAkciJL  Esl&mlaiA 

Some  of  the  ba#lc  proportion  of  matrix  polynomial# 
are  considered  in  thin  chapter ,  flection  3*1  oonnern#  itself 
with  matrix  polynomial  interpolation,  A  genera  11  nation  or 
the  fundamental  noalar  polynomial#  la  given.  Neprenenlatt on 
theorem#  for  matrix  polynomial#,  lambdtt-matrlaen ,  and  lambda- 
vector#  are  presented  in  Section  3.2.  Section  3,3*atudiea 
the  fundamental  matrix  polynomial#. 


3.1  Interpolation.  Oiven  aoalars  the  fundamental 

m 

polynomial#  m4(x)  *  ■■  —  ,  where  p(x)  i  TT  (x-#,), 

1  <*-,>»•<•!>  W  ‘ 

are  of  great  importance  In  Interpolation  theory,  Their  uee- 

fulneoa  oomea  from  the  fact  that  m^a^)  ■  Gjj.  Wo  will  now 

generallxe  thla  for  our  matrix  problem, 

Definition  3.1.  flLy.jp  A  Ul  &£  si»***»V  ^ 

ryndMantal  mUt £U  MtenwMv  uiiuisl^  team  mil* 
polynomials,  M^X) ,» » •  ,Mm(X) ,  ouch  that  W  ■  V- 

Suffldent  condition# ,  on  the  oet  of  matrices 
sl'**’,Sm*  for  a  fundamental  matrix  polynomials  to 

exist  uniquely  will  be  given  In  Theorem  3.2.  First,  however, 
we  need  the  following  results. 

Theorem  3,1  Given  m  pairs  of  matrices ,  (XA )  1  •*  1,* • • ,m, 

thou  there  exiata  j  unloue  matrix  polynomial 
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t  «  « 
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NX'  »  A,x'*“'  ♦  A.,XW’S  ♦  •••  *  Am,  mat!  JJui  NX,)  -  V, 
to:  1  *  u  mb!  aoU  il  v(x,.---.xB)  u  otajiiimsUAE' 

Proof i  l*(Xj>  ■  Yj  for  1  *  l»aaalm  t»  equivalent  to 


'Wl*"’**!* 


m 


,m-l 


X?-1 

m 


Corollary  3.1  01 vn  m  naira  of  matrlota,  (XjjYj),  1 »  1 , *  *  * ,m , 

Urn  MQlflMi H  flaiimlni  &  wli  m&£±&  aalxafiBl&l 

P( X)  •  Xm  ♦  A^*"1  +  aaa  +  Am,  auoh  thft  P(X1)  »  Y1  for 

*  ■  ii* ••.»»  UiM  anliL  u  v(xi»***»V  n  aanalagalis- 

Proofs  Ltt  ^  *  Yl*  xi  and  •PPly  Thaoram  3.1  to  ( I 

Lot  M( X)  hava  a  oomplata  not  of  solvents, 
auoh  that  7(8^,* aa »Sn)  la  nonalngular.  Aocordlng  to  Theorem 
3,1,  there  exists  a  unique  matrix  polynomial 

Mt(X)  *  aJ^X*""1  +  +  A^1*  (3.1) 

ouch  that 

M1(V  "  6i j1  ‘  (3.2) 

Note  that  M^(  X)  has  the  sasne  solvents  aa  M(X),  except  SA  has 
been  deflated  out.  The  M^Xj’a  are  the  fundamental  matrix 
polynomials , 
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t)oriot«  by  V(a^»*  • » *  *  »nm)  tht‘  block 
Vandermonde  at  the  m-1  solvents,  S^,«  •  •  ,3m,  with  8^  deleted, 

Theorem  3*2  If  matrloes  Sj,***^  are  auoh  that  VCSj  ,• • • ,Sm) 
Al  nonaincular,  than  there  axlat  unique  matrix  polynomlala 
Ma(X)  i  A^X1”"1  +  •••  +  A^1*,  for  1  *  1,*  •  •  »m,  auoh  that 
M^(X) . *  *  * .M^X)  are  fundamental  matrix  polynomlala.  If . 
furthermore .  ,Sk-1,Sk+1,**»  ,Sm)  jJSL  nonalnaular,  then 

A^k*  Ai  nonelngular. 

Proof:  V(S^,*»»*Sm)  nonalngular  lmpllee  that  there  exists 
a  unique  set  of  fundamental  matrix  polynomials, 
*1<X> • * .Mm(X) .  V(SX,. • • »Sk-1,Sk+1,‘ • • ,Sm) 
nonsingular  and  Corollary  3*1  Imply  that  there 

exists  a  unique  monlo  matrix  polynomial 

» 

Nk(X)  *  X"*-1  *  N[k)Xm“2  +  •••  +  N^k),  suoh 
that  NkCSj)  ■  ft  for  J  +  k.  Consider 
Qk(X)  5  Nk(Sk)MkCX),  Qk(Sj)  -  Nk(Sj)  for 
J  •  1,  ••*,!».  Slnoe  VO^,*  ••  *Sm)  18  nonsingular 
and  both  Qk(X)  and  Nk(X)  are  of  degree  m-1.  It 
follows  that  Qk(X)  5  Nk(X).  Thus, 

Nk(X)  I  .  Equating  leading  coeffi¬ 

cients,  we  get  I  »  Nk(Sk)A^  and  thus 
Is  nonsingular.  # 

3.2  Representation  Theorems .  The  fundamental  matrix  poly¬ 
nomials,  M1(X),»**  ,Mm(X),  oan  be  used  in  a  generalized 
Lagrange  interpolation  formula.  Paralleling  the  scalar  case 
we  get  the  following  representation  theorems. 
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Theorem  3.3  If  matrices  S^*  •  •  ,Sm  are  such  that  VCS^*  •  •  ,Sm) 
la  nonsingular.  and  MX(S)  ,•  •  •  ,Mm(X)  are  a  set  of  fundamental 
matrix  polynomials ,  then,  for  an  arbitrary 

G(X)  s  B-jX1"”1  +  •••  +  Bm,  (3.3) 


it  follows  that 


m 

G(X)  -  £  Q(S1)M1(X).  (3.4) 

1-1 


m 

Proof:  Let  Q(X)  -  GCS^M^X).  Then  Q(S1)  -  Q(S1) 

1-1 

for  1  ■  l,***,m.  Since  the  block  Vandermonde  is 
nonsingular,  it  follows  that  Q(X)  is  unique  and, 
hence,  G(X)  =  Q(X).  # 

A  lambda-matrix  was  defined  as  a  matrix  polynomial 
whose  variable  was  restricted  to  the  scalar  matrix  XX.  Thus, 
the  previous  theorem  holds  for  lambda-matrices  as  well. 

Corollary  3.2  Under  the  same  assumptions  as  in  Theorem  3.3, 
for  an  arbitrary  lambda-matrix 

G(X)  =  E^X1""1  +  •••  +  Bm,  (3.5) 


it  follows  that 
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m 

Q(X)  -  £  G<Si>Mi(X>*  (3.6) 

i-1 

A  basis  for  lambda-vectors  will  be  presented  next. 

Theorem  3.4  Lf  M(X)  has  distinct  latent  roots,  pl»*“»pmn* 
with  right  latent  vectors  then  for  an  arbitrary 

lambda-vector 

g(X)  =  v^"1”1  +  •••  +  vm  (3.7) 

there  exists  a  unique  set  of  constants  , . . . ,o  ,  such  that 

mn 

si«-Z*ir^:V  <3.s) 

i-1  1 

Proof:  If  the  latent  roots  of  M(X)  are  distinct,  then  the 
eigenvectors  of  the  block  companion  matrix  (Theo¬ 
rem  2.3  (Hi))  form  a  basis  for  vectors  of  dimen¬ 
sion  mn.  By  equation  (2.13)  lambda-vectors 

b^  are  formed  by  partitioning  the  eigen¬ 
vectors  of  the  block  companion  matrix  into  the 

vector  coefficients.  The  o^'s  are  those  required 

T 

to  write  (v, .••*,v  )  as  a  linear  combination  of 
1  m 

the  eigenvectors  of  the  block  companion  matrix.  # 

3.3  Fundamental  Matrix  Polynomials .  Fundamental  matrix  poly¬ 
nomials  were  defined  such  that  M^Sj)  "  ^lj1,  A  result 
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similar  to  equation  (2.9)  can  be  derived  based  on  the  funda¬ 
mental  matrix  polynomials.  It  was  previously  (Section  2.1) 
developed  using  matrix  polynomial  division. 

Theorem  3.5  I£  M(X)  has  a  complete  set  of  right  solvents , 

Sl»  3UCh  that  v^si»***»sm)  —  V(S1,‘ “,Si-l*Si+l»*  “,Sm) 

are  nonsingular  and  M^CX) ,•  •  • ,Mm(X)  are  the  set  of  funda¬ 
mental  matrix  polynomials  ,  then 

M1(X)X  -  S1M1CX)  =  A^MU),  (3.9) 

where  is  the  leading  matrix  coefficient  of  M^CX) . 

Proof:  Let  Q^X)  h  M±(X)X  -  S.M^X).  Note  that 

Qi  ( S j  )  ■  £  for  all  J  .  M(X)  is  the  unique  monic 
matrix  polynomial  with  right  solvents  S1,***,Sjn 
since  is  nonsingular.  The  leading 

matrix  coefficient  of  Qi(X)  is  which  is  non¬ 
singular,  since  V(S^, •••  '**  »Sm)  is 

nonsingular.  Thus,  M(X)  =  A^"^  Qi(X).  # 

A  previous  result  (equation  (2.5))  stated  that  if 
was  a  left  solvent  of  M(X),  then  there  exists  a  unique, 
monic  polynomial  P1(X)  of  degree  m-1,  such  that 

M(X)  =  P1(X)X  -  R1F1(X).  (3-10) 

Comparing  equations  (3-9)  and  (3.10),  we  obtain  the  following 


result . 
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Corollary  3.3  Under  the  conditions  of  Theorem  3.5 
FjOO  2  [a“>]  \(X)  and^ 

Ri  *  [Ai1)]'lsiAi1)  <3-n) 

Is  a  left  solvent  of  M(X) . 

If  M(X)  has  a  complete  set  of  right  solvents, 

Si,...,Sm,  such  that  VCS1#«*sSm)  and  V(Sp»  •  *»s1_1»s1+1**  *  *»Sm) 

for  i  ■  l,***,m  are  all  nonsingular,  then,  by  equation 

(3.11)»  there  exists  a  complete  set  of  left  solvents  of 

M(X) ,  such  that  R.  is  similar  to  S,  for  all  i. 

x  m  l  l 

Corollary  3*1*  Under  the  conditions  of  Theorem  3*5,  if  R^^  is 

defined  as  in  equation  (3*11) »  then 

HjCX)  2  [aJ1}]  1f?1  (  X )  -  (IX-RjT^U).  (3.12) 

Proof:  The  result  follows  from  equation  (2.11)  and 

Corollary  3.3.  # 
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It  will  be  shown  that  the  X1  and  X2  in  this  example 
cannot  be  the  complete  set  of  solvents  of  a  monic  matrix 
polynomial.  First,  however,  the  following  is  needed. 

Lemma  4 . 1  Let  matrix  A  have  distinct  eigenvalues ,  and  N  be  a 
subspace  of  En  of  dimension  d .  Suppose  further  that  if  v  c  N , 
then  Av  €  N.  Under  these  conditions ,  d  of  the  eigenvectors 
of  A  are  in  N. 

Proof:  Let  Av^^  ■  for  i  -  l,»««,n.  The  set  of  v^s 

is  a  basis  for  En,  since  A  has  distinct  eigenvalues. 

Let  v  €  N  C  En,  and  order  the  {v^  such  that 
s 

v  «  civi  Cj  0  for  1  ■  l,»»*,s.  Let 

1-1 

3 

P(t)  -  H  (t-Xj),  then  P(A)Vj  -  0  for 
J-2 

J  -  2 , • • •  ,s .  Hence, 


s 

P(A) v  -  C1P(A)v1  -  c1P(A)v1 
i-1 
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Let  di  “  ci  (  H  **  Thus, 

\J-2  / 

P(A) v  e  N.  Similarly,  v^  e  N  for 

i  =  l,***,s.  The  lemma  follows,  since  v  e  N 
was  arbitrary.  # 


Theorem  4.1  If  M(X)  has  distinct  latent  roots t  then  there 
exists  a  complete  set  of  right  soivt nts  of  M(X)  ,  , * • • ,Sm, 

and  for  any  such  set  of  solvents ,  VCS^,  •  •  •  ,Sm)  is.  nonsingular. 


Proof:  The  existence  was  proved  in  Theorem  2.7*  ^i»*‘*»sm» 

being  right  solvents  of  M(X)  ■  Xm  +  A^X171-1  +  •  •  •  +  Am, 
is  equivalent  to 


I 

S, 


m 


K>- ••>-*:) 


«m-l 

51 


(4.3) 


Assume  det  V(S^,  , •  •  •  ,Sm)  *  0,  and  let  N  be  the  null 
space  of  V(S^,* • * ,Sm) .  That  is,  v  e  N  if  and 
only  if  V( S ,•  •  •  ,Sm)v  ■  0.  Since  in 

equation  (4.3)  exist.  Joining  any  row  of 
(-Sx ,•  •  •  ,-Sm)  onto  v(S2»*”»Sm^  gives  a  lar8er 
matrix  but  with  the  same  rank  as  V(S1, • • • ,Sm) . 

Thus,  for  all  v  c  N,  (si»**’»s^)v  “  £•  Hence,  for 


all  v  e  N 
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V(S1>-->Sm)diag(S1,-“>Sm)v. 

(4.4) 


Letting  A  *  diag(S^ , • • • ,Sm) ,  equation  (4.4)  shows 
that  for  all  v  e  K,  Av  e  N.  Since  A  has  distinct 
eigenvalues,  Lemma  4.1  applies,  and  there  are  as 
many  eigenvectors  of  A  in  N  as  the  dimension  of  N. 
The  eigenvalues  of  diagtS.^ , •  •  •  ,Sm)  are  the  eigen¬ 
values  of  the  St’s,  and  the  eigenvectors  are  of  the 
T  T  T 

form  (0  ,v  ,0  ) ,  where  v  is  an  eigenvector  of  one 
of  the  Sj-'s.  This  is  because  if 


then  Sj^v  *  Av  and  SjW  ■  Aw.  This  cannot  be 
since  and  Sj  do  not  have  any  common  eigenvalues. 
Let  an  arbitrary  eigenvector  of  diag(S1 ,• • • ,Sm) , 

(oT,vT,0T)  ,  be  in  N.  Then 


"  40 


1 

•  •  % 

I 

\ 

s . 

i  t  t 

a 

0 

1 

m 

• 

• 

• 

« 

• 

a 

V 

„m-l 

°1 

•  •  • 

0m-l 

J 

m 

ft/ 

But  then,  Iv  0  which  in  a  contradict. ion.  Thun 
det  V(S1,»*.  ,Sm)  ft  0.  II 

The  example  ouunldered  before  thin  theorem  wan  a 
cane  where  matrices  X1  and  Xj  had  distinct  and  disjoint 
eigenvalues  and  det  V(V1>Xg)  »  0.  Thus,  by  the  theorem, 
they  could  not  be  a  complete  set  of  right  solvents  for  a 
monic,  quadratic  matrix  polynomial.  In  contrast  with  the 
theory  of  scalar  polynomials,  we  have  the  following  result. 

Corollary  4.1  There  exist  sots  containing  m  matrices  whloh 
are  not  a  set  of  right  solvents  for  any  matrix  polynomial  of 

■  .III.  «  .  l  ■  i  I  «■>  m  Ml  I  ■MM 

degree  it. 

A  generalization  of  equation  (4.1),  that  the 
Vandermonde  of  scalars  is  the  product  of  the  differences  of 

the  scalars,  will  be  given.  Let  c  (X)  be  a  monic 

^1*  *  * 

matrix  polynomial  of  degree  d  >_  k  with  right  solvents 
3 1  •  ,3^.  The  superscript  d  will  be  omitted  if  d  »  k. 

Note  that  this  matrix  polynomial  need  not  necessarily  exist, 
n*'r  be  unique. 

Theorem  4.2  If  ,S^)  is  nonsingular  for  k»  2,»»»,r-l, 


then 


tlol  VUj 

I' poof  i 


Dot  VtSp 


**  *l  i  » 


,1  I  » 


»®p) 


dot 


V  ( :i  ^  * » * 


•‘Vi* 


-!>•<.  N 


VM"r. 


<V 


(<(.')) 


Tho  noMwlnguUrtty  of  V(8 
3,1  fuapantte  that  M„  ... 

ii  I  1  ’  * 


J  »"  *  ln*\v 

„  (X)  oxiatu  uni u«t»  ly  . 

klp-l 


Tho  dotopmtnant.  of  V(Sj,»«»  ,8  )  will  b*  ovaluatori 
by  block  Qouaalan  a  llmi  nation  uatn*  th*»  fact  that 


dot 


/A  B\  /  A+KC  R+ED  \ 

(c  D)-d*‘(c  o  )• 


CM.fi) 


...,sr) 


dot 


1 

r-  1 


I 

a. 


»r-l 


•  dot 


V*i 


-r-l  «r»l 
s2  S1 


» *  • 


S  «S, 
r  1 


r  1 


dot 


I  I 


VS1 


3“S1 

...  sp-s1 

lS^S2(S3) 

•••  Mc2s  (S  ) 
S1S2  r 

0 

S^S2)(S3) 

"•  "s'S^V, 

(*. 7) 
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(Sp-a^)  la  nonaingular,  sinoa 

dot  0^-3^)  •  dot  V(S^taa)  i*  0.  It  will  tod  shown 

that  after  k  stops  or  ths  block  Gaussian  elimina- 

t Ion »  ths  general  term  for  ths  i,J  block,  1,J  >  k, 

Is  Assume  it  Is  true  afttr  k-1  stops, 

1  k 

Thon,  sftor  k  stops,  tho  1,J  element  Is 


•^(1**1)  (a  \  y(i"l)  /«  »u(k-l)  /e  (S  ) 

Msi**’Sk-l  1 J  M®1*  *  *®k-l  ^k  N®1* * Sk4  "si**'Sk-l  ’ 


This  Is  moroly  Ne^Js  (X)  evaluated  at  X  ■  S . , 

1  k  J 

Using  tho  faot  that  tho  determinant  of  a  blook  tri¬ 
angular  matrix  Is  tho  produot  of  tho  determinants 
of  tho  diagonal  matrloos,  (see  Householder  [5]), 
the  result  follows,  # 

Corollary  4.2  If  V(Sl# . . . ,Sk-1)  I5.  nonsingular  and  Sk  is 

not  a  weak  solvent  of  Mg  ,,,s  (X),  thon  V(S1#»»*,Sk)  ^s 

1  k — 1 

nonalneular. 

It  la  useful  to  be  able  to  oonstruot  matrix  poly¬ 
nomials  with  a  given  set  of  right  solvents. 

Corollary  4.3  Qlven  matrloea  such  that  V(S1,*»»,Sk) 

Is  nonslngular  for  K  ■  the  Iteration  NQ(X)  ■  I 

NiW  -  n^cxjx  -  Ni-:i(si)siNi-i(si)Ni-i(x) 


(4.8) 


il  sunnifl  AD&  ULUl  «J1  m  flUIU  QMU  DlUtllA  BSly.ngfflifll 
Nm(X),  DASjl  M  Nm(Sl>  *  fi  Ift!  *  *  !.•••»»• 

Proofs  NX(X)  *  X  -  Sx -Ws  (X).  As  sum*  Nk(X)iMg  ...s  (X). 

1  1  k 

Then,  from  equation  (4,8),  *  fll  for 

1  ■  l,*»*,k+l  and,  hence,  Wx)  1  V*ku(X> 

Tha  aaquanoa  of  blook  Vandarmonda  being  nonaingular 
guarantees  tha  nonsingularity  of  N^d^).  § 

Corollary  4.4  If  V(S1.»««.3k)  la  nonaingular  for  k»2,««*,m 
Ml  31,*'»  ,Sm  iu  A  flgnaJLMt  III  QL  Tisha  solvents  £l£ 

V”Sm<x)- 

Proofs  Tha  roault  follows  diraotly  from  Theorem  3.5,  where 
we  obtained 


(IX-S4)M«  (X)  -  aS1)mu>. 


#  (4.9) 


CHAPTER  5 


A  Matrix  Polynomial  Algorithm 

This  chapter  presents  the  paper’s  main  algorithm. 

It  computes  solvents  and  Is  a  generalization  of  one  of 
Traub's  methods.  Seotlon  5.1  gives  the  algorithm.  A  global 
convergence  theorem  Is  presented  In  Seotlon  5*2.  Section  5.3 
considers  computational  aspects  of  the  algorithm  and  has  a 
detailed  flow-chart  of  the  method. 

5.1  A  Generalization  of  Traub * s  Algorithm.  The  following 
algorithm  for  matrix  polynomials,  in  the  scalar  case,  reduces 
to  Traub's  scalar  polynomial  algorithm. 

Algorithm  1  (1)  Let  GQ(X)  ■  I  and  generate  matrix  poly- 

nomials  CL(X)  by 
■  n 

°n+l(x)  "  °n<x)x  -  (5.D 


for  n  ■  0, !*•••, L-l,  where 


0n(X)  ; 


ojx”"1  + 


+  a 


n 

m' 


(5.2) 


Then,  (11)  let  XQ 


and  generate 


X 


1+1 


“  ol(x1)g 


-1 

L-l 


(xA) . 


(5.3) 


-  i|i»  - 


The  algorithm  has  two  atagos.  The  first,  a  gener¬ 
alization  of  Sebastiao  e  Silva' 3  algorithm  (see  Householder 
[  *0) ,  generates  a  sequence  of  matrix  polynomials.  Equation 
(5.1)  ensures  that  each  of  these  matrix  polynomials  is  of 
degree  less  than  m,  the  degree  of  M(X).  Under  suitable  con¬ 
ditions  Gn(X)  =  (ai)  Gn(X)  w*11  he  shown  (in  the  next 
section)  to  converge  to  M^(X),  a  monic  fundamental  matrix 
polynomial . 

The  second  stage  generates  a  sequence  of  matrix 
iterates  which  will  be  shown  (in  the  next  section)  to  con¬ 
verge  to  a  solvent.  The  point  at  which  one  switches  from 
stage  one  to  stage  two,  the  value  of  L,  will  be  considered 
in  Section  5.3* 

5.2  The  Convergence  Theorem.  In  the  proofs  that  Bernoulli's 
method  and  Traub's  scalar  polynomial  algorithms  converge,  the 
main  property  needed  is  that  if  p.^  is  a  dominant  root,  then 
(p^/Pl)n  -  0  as  n  -*■  *,  for  p^  any  other  root.  To  gener¬ 
alize  this  property  to  solvents,  the  following  result  is 
needed,  the  proof  of  which  was  provided  by  P.  A.  Businger  of 
Bell  Telephone  Laboratories. 

Definition  5-1  Matrix  A  dominates  matrix  B  if  a_ll  the  eigen¬ 
values  of  A  strictly  dominate »  in  modulus ,  those  of  B. 

Lemma  5.1  If  matrix  A  dominates  matrix  B,  then  A~nCBn  ■+  0 
a 3  n  ,  for  any  constant  matrix  C . 


Proof:  For  any  e  >  0,  let 


(5.4) 
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B  •  PB(e)(jB(e))PB(e)“1, 

where 


See  Ortega  and  Rheinboldt  [16,  p.  43]  for  a  discus¬ 
sion  on  this  modified  Jordan  form.  Then, 

II  Bn  ||  <  IIPB(e)l!  IIPB<  e>  “1||  (e+max|XB(),  (5.6) 


where  the  norm  is  the  infinity  norm.  Noting  that 


(5.7) 


the  result 
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is  similarly  obtained,  where  PA(e)  Is  defined  as 
in  equation  (5.4).  Combining  equations  (5.6)  and 
(5.8)  we  get 


where  k,  a  function  of  e,  is  independent  of  n. 

i.  u 

When  e  «  0,  the  constant  to  the  n  n  power  is  less 
than  one,  since  maxf XB|/min| XA|  <1.  By  continu¬ 
ity,  there  exists  an  e  >  0  so  that  the  constant 
is  still  less  than  one,  and,  hence,  ||A-nCBn||  •+■  0 
as  n  # 


We  now  give  the  convergence  theorem  for  .Algorithm  1. 
Theorem  5*1  If 

(i)  M(X)  has  a  complete  set  of  solvents  ,  S]L,»  •  •  ,Sm, 

(il)  S1  is  a  dominant  solvent ,  and, 

(ill)  V(S1,***,Sm)  and  V(Sn ,* • * ,Sm)  are  nonsingular, 

then  (i)  Qn(X)  =  (a”)  Gn(X)  *  ^(X),  where  M^X)  is  the 
unique  monlc  form  of  the  fundamental  matrix  polynomial  such 
that  M1(Sj)  •*  <$jjl>  and 

(ID  for  L  sufficiently  large ,  X^^  of  (5.3)  converges 
to 

Proof  of  part  (1):  Prom  equation  (5*1)*  the  result 


W  ‘  °0<Sl)Si  ■  S1 


(5.10) 
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follows.  By  Theorem  3-3  and  equation  (5.10),  we 
got 

m  m 

°n(X)  "  E  Qn(Si)Mi(X)  "  E  (5.11) 

1-1  1-1 

and,  thus, 

m 

al  "  E  SiAl±) *  (5.12) 

1-1 

S.^  and  are  nonalngular  and,  thus,  there  Is  an 

N  such  that  for  n  _>  N,  must  be  nonsingular, 

since  using  Lemma  (5*1)  and  equation  (5.12; 


(5.13) 


as  n  -*■  <*>.  Using  equations  (5.11)  and  (5.12)  and 
Lemma  (5.1),  we  get,  for  n  >.  N, 


(5.14) 
( cont 'd) 
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"  (  2  S“nsjA(iJ  ))  £  S-nsjMl(X) 


(A^1J)  ^(X)  =  MX(X), 


(5.14) 


by  Lemma  5.1.  # 

We  defer  the  proof  of  part  (ii)  of  the  theorem  to 
first  obtain  some  results  which  will  be  needed  In  the  proof. 

Corollary  5-1  Under  the  hypotheses  of  Theorem  5.1* 


(°i)"1«i+1  *  Ri 


(5.15) 


as  n  -►  «,  where  l_s  the  dominant  left  solvent. 

Proof:  Modification  of  equation  (5.1*0  and  Corollary  3.3 

yields  (a?)"1.;*1 1  -  (a£1))"1s1a![1)  -  ^  ™ 

n  ».  if 

The  following  lemmas  all  use  the  same  hypotheses 
as  in  Theorem  5.1.  Let 


<frL(X)  =  ol(x)Ql_1(x) 


(5.16) 


Thus,  stage  two  of  Algorithm  1,  equation  (5.3)  is 


X1+1  - 


(5.17) 
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In  Lemma  5*2  we  show  that  every  right  solvent  Is  a 
fixed  point  of  <j»L(X)  for  each  L.  Lemma  5*1*  shows  that  4>L(X) 
is  defined  for  all  X  in  some  neighborhood  of  the  dominant 
solvent.  Lemma  5*6  gives  the  local  convergence  of  the  second 
stage  of  Algorithm  1.  Finally,  Lemma  5*7  says  that  stage  one 
will  yield  a  point  in  the  locally  convergent  region  (Lemma 
5.6)  of  the  dominant  solvent.  Stage  one  supplies  a  suffi¬ 
ciently  accurate  starting  value  for  the  locally  convergent 
stage  two  and,  hence,  the  overall  algorithm  is  globally 
convergent.  The  proof  of  part  (ii)  of  Theorem  5.1  then 
immediately  follows. 

Lemma  5*2  $L(S)  *  S  for  all  L  and  any  right  solvent  S. 

Proof:  The  result  follows  from  equation  (5.10)  and  the 
fact  that  Go(X)  *  I.  ft 

Lemma  5*3  There  exl3t3  a  nontrivial  ball  B,  centered  at  S^, 
such  that  for  all  X  g  B 

(1)  ||  I-M1(X)||  <  K  <  1,  (5*18) 

and 

(ii)  II  Mj  ( X )  ||  <  D,  J  ft  1,  (5.19) 

for  s ome  D  Independent  of  J . 

Proof:  A  matrix  polynomial  is  a  continuous  function  of  its 

matrix  variable.  The  results  thus  follow  from  con¬ 
tinuity  and  the  facts  that  M^(S^)  ■  I  and 
M.(S  )  *  0  for  J  ft  1.  ft 
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It  follows  from  Lemma  5*3  that  for  all  X  €  B, 
M1(X)  is  nonsingular  and 


i 

||I-M1(X)|| 


(5.20) 


Lemma  5.4  £f  X  e  B,  then  there  exists  an  L*  such  that 
4>l(X)  £s  defined  for  every  L  >.  L'. 

Proc* :  For  X  €  B,  let 


Vj(X)  -  MjCXjM^CX) 


and 

m 

WL(X).  .  £  S^sJ-VjtX). 
J-2 

Then, 


(5.21) 


(5.22) 


m 


Vi(x) 


E  sjL'S(x) 

J-l 


m 


Sl"1  I1  +  £  S^(L"1)sJ"1VJ(X)J  MX(X) 
J-2 


s^“1(i+wl-1(x))m1(x). 


(5.23) 


Note  that  V#L(X)  -  £  as  L  uniformly  for 

X  €  B.  This  follows  since 


5?  - 


Lemma  5- 


where  0 
Proof : 

Lemma  5* 

Proof : 


l|Vj(X)||  -  IS  Mj  (  X )  M~  «  i‘;..  .  ' 

by  Lemma  5-3-  Thus,  1  +  W  (X)  ►  1  as  i,  »  •*- 
and,  hence,  I  +  W^(X)  is  invertible  for  large  L. 
By  equation  (5.23),  0L_1(X)  is  invertible  for 
large  L  and  the  result  follows.  ft 

If  X  «  B,  then 

|SjVX)S“L|  1  ^Li|WJ(X)||!|M"1(X)ll  <  SIS-  ,  (5.2  : 


<  o  <  1,  and  t  Is  a  constant  independent  of  L  and 


The  result  follows  from  equation  (5-9) >  where 

o  ■  max  |  X „  | /min|  |  <  1  for  J  /  1.  it 

J  1 


5  If,  XQ  e  B  and  L  is_  sufficiently  large ,  then 
Xi  *  *L(X1-1)  -  Sl* 


Let  X  e  B  and  L  >  L’  of  Lemma  5-^*  Set 


el(x)  -  $L(x)  -  s1. 


(5-25) 


Then,  since 


*L(X)  .  0L(X)0-^(X) 


> 


It  f  ul lown  that 


m 


k..( x>  E 

j-i 


)  V,  J  ~  1 V  1  (  X )  . 


Let 


TJ..,(X) 


( .  ;*y ) 


Thus  ,  by  Lemma  5.5, 


I. 


( X )  ||  < 


0 


an  L  -*  Choooo  I,  large  enough  aa  that. 


m 


EnTj.i,<x)«  iF  i 1 


(5.28) 


J-2 


for  all  X  «  B.  Then, 


m 


EL(X)|I  +  E  Tj,L<X> 

L  J-2 


m 


J-2 


(X) 


gives,  by  equation  (5-25), 


m 


||s1-s1I|toL~1||m1(x)||||m“1(X)|| 
1  -  F 


•1/. 


IIel(x)II  i  £ 

j-2 


(5.29) 


for  all  X  ♦  U . 


stage 

X  is 
o 

Lemma 


A  matrix  polynomial  la  contin¬ 
uously  different l able.  Since  *  ii  for 

j  r1  i,  the  result. 

iiiyxxi  <  tiix-sji. 

where  J  t*  1,  t  »  sup  !Im.(X)II, 

xcB  J 

mean  value  theorem.  Finally, 

IUjUJ-SiII  <  coL"1llx-S1ll  (5.31) 

for  all  X  «  B,  where 


(5.30) 

follows  from  the 


m 


aba 


L  nsrsillTt 

_ _ 

(1-F)(1-K) 


(5.32) 


The  renult  follows  from  equation  (5. 3D,  since 
0  <  o  <  1  and  L  can  bo  takon  large  enough  so 
that  oo-”1  <l.  # 

The  preceding  lemma  gave  convergence  for  the  second 
of  Algorithm  1  if  XQ  e  B.  The  next  lemma  shows  that 
in  B  if  the  first  stage  is  continued  long  enough. 

5*7  For  L  sufficiently  large ,  £  B. 
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Proof: 


Noting  that  a J  »*  5  , 

J-l 

that  in  Lemma  5.6  will  yield 


a  proof  r.imJ  l.ir  to 


(5.33) 


as  L  •.  ft 

The  second  part  of  Theorem  5.1  can  now  be  easily 
proved  using  Lemmas  5.2  through  5>7. 

Proof  of  Part  (ii)  of  Theorem  5.1:  For  L  sufficiently 
large,  Xq  €  B  by  Lemma  5.7.  Lemma  5.6  then 
shows  that  X^  -*•  S^.  ft 

Equation  (5-31)  reveals  the  rate  of  convergence. 

Corollary  5-2  II  ^(Xi-S^l  <  coL“ 1  ||X-S1I|  for  all  X  €  B, 
where  0  <_  a  <.  1. 

This  corollary  shows  that  even  though  the  second 

stage  is  only  linearly  convergent,  the  asymptotic  error 

constant  can  be  made  as  small  as  desired  by  increasing  the 

number  of  iterations  of  the  fir.,..  stage.  The  asymptotic 

error  constant  for  stage  one  will  depend  on 

o  ■  max|Xq  l/minjx,,  |  <1,  while  that  of  stage  two  can  be 

bl 

significantly  faster  than  stage  one.  This  is  the  purpose  of 
the  second  stage,  for  equation  (5.33)  shows  that  stage  one 
can  also  yield  S^. 


A  computational  <11  f !'l - 


I  '•■pj-ut  <’■  is  ■  1  •  li*  ijif  t  on:;  , 

cully  in  pen*  rut  tug  the  :irqurne<  0^(X)  1  ri  a  tape  one. 


°n+l(X)  "  Q„<x>x  "  «Jm(X)  .  (5.  3*0 


If.  that  the  matrix  coefficient*!  of  G^X)  will  grow  expo¬ 
nentially.  Thin  may  be  avoided  by  generating  Gn(X)  l)y 


and 


Kn+1(x)  -  an(x)x  -  oJm(x) 


(5.35) 


I  W** 

It  k"+1  II 

WX>  ■ 

(  WX> 


If  K^1  /  £ 


otherwise , 


( b . 36) 


where  and  are  the  lead  matrix  coefficient*!  of  Gn(X)  and 
K  (X),  respectively .  Then  let 

aL-1(X)  s  aL_1(X)  (5-37) 

and 

GL(X)  -  aL_1(X)X  -  a^”1M( X) .  (5.38) 

Now,  G .  ( X )  and  Gr  .(X)  contain  the  name  scalar  constant  that 

la  l-J1"*  .1. 

wan  built-up  In  normalizing  Gn(X)  in  equation  (5-36).  Thun, 


Ui«“  ('onr.lant  vanishes  In  ^  (  X  >  *  ''i ,  <  X )  >'«  *  (X),  tn-i  •?,< 

1 1  1 1  u"  l 

growl  h  of  the  coefficient  has  been  .‘stopped.  Furthermore , 
^n(X)  '  5n(X)* 

The  following  strategy  in  used  to  switch  from 
stage  one  to  stugo  two. 

(i)  Compute  0n(X;  until  the  matrix  polynomials  tend  to 
nettle  down. 

(ii)  Compute  stage  two,  as  long  an  rapid  convergence 

appears  to  be  occurring.  If  stage  two  is  too  slow 
or  is  diverging,  resume  3tage  one  for  several  more 
steps . 

A  flow-chart  of  the  algorithm  that  exhibits  the 
strategy  follows.  It  is  guaranteed  to  work,  using  exact 
arithmetic,  for  any  matrix  polynomial  satisfying  the  condi¬ 
tions  of  Theorem  5.1.  The  actual  computer  program  that  was 
used  to  test  this  algorithm  appears  in  Appendix  D. 
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CHAPTER  6 


The  Block  Bernoulli  Method 

This  chapter  covers  a  generalisation  of  Bernoulli’s 
scalar  polynomial  method  to  the  matrix  polynomial  problem. 

A  relationship  is  shown  between  it  and  Algorithm  1. 

Definition  6.1  For  the  matrix  polynomial 

M(X)  -  Xm  +  AjX"1”1  +  +  Am,  (6.1) 


the  block  Bernoulli  iteration  is 


Y  +  A  X  + 
Ai+i  T  AiAi 


+  AmXi-m+l  "  2.* 


(6.2) 


with  X  ,X  given  starting  matrices . 

The  general  solution  to  the  matrix  difference 
equation  (6.2)  is  obtained  precisely  as  in  the  scalar-  case. 

Theorem  6.1  If  ere  right  solvents  of  M(X),  such 

that  V(S1 ,• • * ,Sm)  is  nonsingular,  then 

Xi  -  S1^  4  ...  ♦  sjjpn,  (6.3) 

Is  the  general  solution  to  the  matrix  difference  •equation 
(6.2),  where  o^, * * *  #am  are  matrices  determined  by  the  initial 
conditions . 

Proof:  Substitution  of  equation  (6.3)  into  equation  (6.1) 
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yields 


m 

23  AJXi+J+l 

J-0 


m 


m 


EajI  °?i+\ 


j-o 


k-l 


«i+2j-m+l 
Sk  °k 


where  Aq  ■  I.  The  nonsingular  block  Vandermonde 
insures  that  can  be  uniquely  calculated 

in  terms  of  X0,X_1, . • . »X_m+1*  If  X4  is  the  general 
solution  to  equation  (6.2)  and  XA  -  5^  for  the 

A 

first  m  consecutive  subscripts,  then  X^  -  X^^  for 
all  i.  # 

In  the  scalar  Bernoulli  method,  if  there  is  a 
dominating  root,  then  the  ratio  of  the  Bernoulli  iterates 
v  ^verges  to  the  root. 

Theorem  6.2  If  M(X)  has  solvents  S^, •  •  •  ,Sm,  such  that  S.^  is 
a  dominant  solvent,  and  V(S^,***,Sm)  ijs  nonsingular,  and  if 
Xo,X_i,.  •  •  are  chosen  so  that  a1  is^  nonsingular,  then 


(i) 

Xn\Xn  * 

n-1  n 

allsi°l*  and 

(il) 

X  X*1 
n  n-1 

S1  as  n  . 

Proof: 

Part  (i) 

is  obtained  from 
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Ms  **■)(£*'. 


L*  e  s"i(n-1>sr1“i)  fiai+  s  si 


1  si°i 


■+  a”^S^a^. 


For  part  (il)» 


(s  1  >)  (i+vns;-V11s-(n-1  >)'1. 


where 


n  c-(n-l) 


E 

J-2 


(6.4) 


n-1.  o-(n-D 


E  TVi 


(6.5) 


Furthermore 


•  Hns"'1°ilsi<n’1>  *  a  8nd 
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VT V11!"'  11  *  a-  Thu..  vCi  * 'V 


The  block  Bernoulli  iteration  (6.2)  can  also  b*» 


written  an 


i-m+2 


1 1  **m+ 1 


-Vi  ••• 


(6,6) 


where  is  a  matrix  of  order  n.  Equation  (6,6)  looka  like 


eigenvector  powering  except 


Vt-m+l' 


la  not  a  vector  in 


the  usual  sense.  A  theory  of  such  power  methods  will  be 
considered  in  Chapter  8. 

Consider  the  same  power-like  method  on  the  trans¬ 
pose  of  the  matrix  In  equation  (6,6).  That  is,  consider 


0  •  •  •  0 


(6.7) 


I 


-  ft  1  * 


This  la  preolaely  atagr  one  of  Algorithm  1.  Theae  raaulta 
are  generallaatlonn  of  what  oooura  in  the  aoalar  oaat.  See 
Traub  [?!]. 


OHAl'TKM  7 

A  Lkm^m 

In  thin  chapter  wt  present  an  algorithm,  sgstn 
baaed  nn  Traub'e  scalar  polynomial  algorithm,  to  obtain  a 
dominant  latent  root,  .leotton  ?.l  gives  tha  algorithm  and  a 
convergence  theorem.  .Section  7.5  consider*  another  gener¬ 
alisation  of  tha  Hernnulli  method  and  ita  rt lationahip  to 
the  algorithm  of  faction  7.1. 

’M  A  tlSLiM'A  tUi&i  £11  Lmm&.SAftr V g «  Tha  basic  approaoh 
to  tha  lambda-matrix  problam  taken  in  this  paptr  la  to  find 
a  chain  of  solvents  and,  than,  to  find  the  eigenvalues  of  eaoh 
mat i*l x  of  the  chain.  Kur  Algorithm  1  to  yield  a  solvent, 
which  la  needed  in  this  approaoh,  a  dominant  solvent  must 
exlat.  Since  a  dominant  solvent  need  not  exist,  an  altar- 
native  approaoh  will  be  considered. 

Algorithm  2  Let  go<A)  be  ftn  arbitrary  m-1  degree  lambda- 
vector  .  generate 


gk+lU)  "  gkU>X  ' 


(7.1) 


where 


gk(» 


v 


(k) ,m-l 
1  A 


+ 


e  e  a 


■f 


(7.2) 


Algorithm  2  is  another  generalization  of  Traub’s 


scalar  polynomial  algorithm.  It  seeks  a  dominant  latent  root. 


Substituting  equations  (7-3)  and  (7.4)  into  equa- 

mn  -  ft(«On 

tion  (7.1),  one  gets  M(A)  J]  -£ — r - i - L  b  .  0 

^  A  -  p.  i  — 

i*l  1 
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for  ill  Thus,  whara  0^  • 

Using  this, 


mn 


i  »i»;  -i 


L<*> 


i-l. 


mn 


*»*  E  »i^i 

1-1 


% 


b 


1 


as  k  *  «,  If  61><0,  ainoe  b1  is  unique  to 
within  a  scalar  multiple.  Furthermore, 

™  ILMCp,) 

♦  E  pT^pT  bl  and'  thus' 

1-2  1  1 


slnoe 


rlM<pl)  "  iT» 


we  get 


rJg0(Pi)  “  B^M'tp^b.^  (7.5) 

Finally,  r^gQ(p1)  r>  0  ltaplles  Bj,  *  0.  For 
part  (11) 
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f  u 

Let  (v)r  denote  the  r  component  of  vector  v. 
Corollary  7.1  Under  the  condltlona  of  Theorem  7.1»  If 

, .  <#"% 

(*’i)p  *  a.  ttssn,  *  pr 

Proof: 
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If  division  of  veotora  ia  daf tried  as  componentwise 

fk+TN  Tv) 

division,  then  v^  '♦v^ '  is  an  n  dimension  vector,  with 
each  component  an  estimate  of  p^.  In  a  manner  similar  to 
the  last  two  proofs,  we  get  the  following  result. 

Corollary  7-2  Under  the  conditions  of  Theorem  7.1, 

vu> 

max  VW  1 

Consider  again,  the  first  stage  of  Algorithm  Is 

Qk+1(x>  -  ak(.x)x  -  a*M(x),  (7.6) 

where 

Qk(X)  5  a^x”1-*1  +  +  ajj.  ■  (7.7) 

Transpose  both  sides  of  equation  (7.6)  and  substitute 
X  -  XI  to  get 

T 

ak+i(x)  -  a£(x)x  -  ht(x)(o^)  .  (7.8) 

Let  gk(.X.)  be  the  lambda-vector  formed  by  taking  the  ith 

T 

column  of  the  matrix  coefficients  of  Qk(X).  Then, 

gk+l<A)  -  gk(X)X  -  MT(X)v^>1,  (7.9) 

where  ^  is  the  leading  vector  coefficient  of  gk(A). 
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T 

Equation  (7.9)  is  precisely  Algorithm  2,  operating  on  M  (X). 
The  latent  roots  of  M(X)  are  the  same  as  those  of  M  (X). 

Thus,  the  computations  of  Algorithm  2  are  done  by  Algorithm  1. 
Even  if  Algorithm  1  does  not  work,  due  to  the  lack  of  a  domi¬ 
nant  solvent.  It  is  possible  to  obtain  a  dominant  latent 
root  by  extracting  the  computations  of  Algorithm  2  from  the 
computations  (successful  or  not)  of  Algorithm  1. 

The  convergence  theorem  for  Algorithm  2  has  the 
T 

requirement  that  riK0(P1)  ?  0.  Since  Algorithm  1  used 
Qq(X)  "I,  it  follows  that  at  least  one  column  of  equation 
(7.8)  satisfies  this  requirement. 

7.2  A  Vector  Bernoulli  Method.  A  block  (matrix)  Bernoulli 
Iteration  was  previously  considered.  Another  generalization 
of  Bernoulli's  method  is  now  presented.  Similar  ideas  may 
be  found  in  Quderley  [33* 

Definition  7-1  For  the  lambda-matrix 

IXm  +  A1Xm“1  +  •••  +  Am,  (7.10) 

the  vector  Bernoulli  iteration  is 

V(k+U  +  A^vOO  +  ...  +  ^yU-m+l)  .  o ,  (7.11) 

with  v(0),...,v(-m+1)  given  vectors . 
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Equation  (7.11)  can  be  written  aa 


v(k-m+2)| 

0  I 

*1  * 

v(k-m+l) 

• 

V<k> 

m 

•  • 

•  • 

0  I 

• 

• 

v<k-l> 

v(k«) 

-A  -A  ,  *  •  •  -A, 

v(k> 

\  9 

m  m-l  1 

This  is  Just  the  eigenvector  powering  on  the  block  transpose 
of  the  block  companion  matrix.  Eigenvector  powering  on  the 
block  companion  matrix  is 


vO'+D1 

m 

• 

• 

/ 

• 

v(k.l) 

v2 

(k+l)l 

1  ' 

-A. 


m 


-A 


ITVrl 


-A, 


,00\ 


m 


4k) 

.00 


(7.13) 


Multiplying  out,  we  get 

v<k+l) 

m 

V(1C+1) 

m-l 


,(k> 

m 


-  A  vlk) 

m  x 

-  A  1vJk) 

m-l  l 


(7.14) 


r(k+l)  „  v(k) 


-  A  v(k> 
Alvl 


Then , 
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ek+1(X)  «  gk(X)A  -  M(A)v<k),  (7.15) 

where  the  lambda-vector 

gkU)  =  v(k)xm-l  +  ...  +  VU)#  (7.16) 

is  obtained  by  multiplying  the  ifc^  equation  of  (7.1*0  by 
A*"1  and  adding. 

Equation  (7.15)  is  precisely  Algorithm  2.  Consec¬ 
utive  substitutions  of  equations  (7.1*0  yields 

y( k+i)  +  A  v(k)  +  ...  +  A  (k-m+1)  .  (7.17) 

l  li  mi  — 

Thus,  the  leading  vector  coefficient  of  Algorithm  2  is  a 
vector  Bernoulli  iterate.  This  is  a  generalization  of  what 
occurs  in  Traub's  [21]  scalar  polynomial  algorithms. 


CHAPTER  8 


Block  Eigenvalue  Problem 

A  block  eigenvalue  problem  Is  considered  in  this 
chapter.  Let  A  be  a  given  matrix  of  order  mn.  The  matrix  X 
of  order  n  is  desired  such  that  there  exists  an  mn  by  n 
matrix,  V,  of  full  rank,  so  that  AV  ■  VX.  Power  methods  of 
the  form  V^+1  ■  are  considered,  where  is  an  mn  by  n 

matrix.  It  was  shown  in  Chapter  6  that  the  first  stage  of 
Algorithm  1  Is  of  this  form,  where  A  is  the  block  companion 
matrix.  Sections  8.1  and  8.2  define  the  problem  and  con¬ 
sider  complete  sets  of  block  eigenvalues.  In  Section  8.3  we 
present  some  generalizations  of  linear  algebra  with  respect 
to  this  new  formulation.  The  application  of  the  new  eigen¬ 
value  problem  to  the  block  companion  matrix  is  given  In 
Section  8.4.  Also  discussed  is  the  relationship  between 
block  eigenvalues  and  right  solvents.  In  Section  8.5  we  pre¬ 
sent  two  algorithms  based  on  eigenvector  powering. 

8.1  Block  Eigenvectors.  Let  the  term  block  vector  denote  an 
mn  by  n  matrix  that  has  been  partitioned  into  a  column  of  n 
by  n  blocks.  It  is  equivalently  an  m-tuple,  each  of  whose 
components  is  a  square  matrix. 

Definition  8.1  A  matrix  X  of  order  n  is  a  block  eigenvalue 
of  order  n  of  matrix  A  of  order  mn,  if  there  exists  a  block 
vector  V  of  full  rank,  such  that  AV  ■  VX.  Visa  block 
eigenvector  of  order  n  of  A. 
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Generally  the  order  of  a  block  eigenvalue  or  block  eigen¬ 
vector  will  be  understood  and  will  not  be  referred  to 
explicitly. 

A  problem  that  has  received  a  good  deal  of 
attention  is  that  of  finding  a  matrix  X  such  that  AX  -  XB, 
where  matrices  A  and  B,  of  orders  m  and  n,  respectively,  are 
given.  Jameson  [63  and  Gantmacher  [2,  p.  215]  are  amongst 
many  authors  who  have  considered  this  problem.  The  main  re¬ 
sult  for  this  problem  is  that  AX  ■  XB  has  only  the  trivial 
solution  X  *  £,  if  and  only  if  A  and  B  have  no  common 
eigenvalues.  This  result  will  be  of  use  in  this  paper. 

Returning  to  the  block  eigenvalue  problem,  we  have 
the  following. 

Theorem  8.1  If  AV  «  VX  with  V  of  full  rank,  then  all  the 
eigenvalues  of  X  are  eigenvalues  of  A. 

Proof:  Let  X  be  an  eigenvalue  of  X  with  eigenvector  u. 

Thus,  AVu  ■  VXu  «  XVu.  Therefore,  either  X  is  an 
eigenvalue  of  A  with  eigenvector  Vu  or  Vu  ■  _Q. 
Since  V  is  an  mn  by  n  matrix  and  it  is  of  full 
rank,  there  exists  a  left  Inverse  to  V.  Thus, 

Vu  ■  0  can  only  occur  if  u  ■  0,  which  cannot 
happen  since  u  is  an  eigenvector  of  X.  # 

Corollary  8.1  If  A  ijs  the  block  companion  matrix .  then  all 
the  eigenvalues  of  a  block  eigenvalue  of  A  are  latent  roots 


of  M( X) 


n  « 


Proof:  The  mult  follows  from  Theorem  fl.l  and  the  fact 

that  the  eigenvalues  of  the  block  companion  matrix 
are  latent  roots  of  its  associated  lambda-matr U . # 


8-2  Cp.ragj.etft  g.ftSl  of  flj£fliS  B,UtRV&lttU»  will  be  shown 
that  a  solvent  la  a  block  eigen. slue  of  a  block  companion 
matrix.  Furthermore!  it  will  be  proved  that  a  matrix  always 
has  a  block  eigenvalue.  Slnoe  a  solvent  does  not  always 
exist  by  Theorem  2.6,  it  follows  that  a  blook  eigenvalue  of 
a  blook  companion  matrix  ia  not  neoesaarily  a  solvent. 

Definition  8.2  A  SL«t  of  f UmHU.11  2l  1  MUlL  U  1 

complete  set  if  the  sei  gl  ill  SM  eigenvalues  2X  these  blook 
e^envalues  is  the  set  of  el&en.va^ftS  1&e  E3i$rjx. 

Theorem  8.2  Every  matrix  A,  of  order  mn,  has  ft  complete  set 
of  block  eigenvalues  of  order  n. 

Proof:  Let  Pi****»Pn  any  n  eigenvalues  of  A  and  let 

P],...,Pn  be  their  aaso  lated  eigenveetors  or  prin¬ 
cipal  veotors,  where  needed.  Then,  V  ■  ( ,  •  • * ,Pn) 
is  a  block  elgenveotor  with  blook  eigenvalue  in 
Jordan  form.  This  process  oan  be  continued  for 
each  of  the  m  sets  of  n  eigenvalues  of  A.  0 


Aa  an  example  of  the  construction  in  the  above 

jp  i  1 


proof,  let  (PiP2P3Pt)”1  A'P1P2P3IV  ■ 


P  1 
P 


Then, 


w 


?•» 


Ady^)  •  (»y\)^  and  A < !» J r ^ n^,  and 

/  U  0  \  /  P  \  \ 

h«n«* ,  [  )  Mint  (  j  are  *  complete  s**i  of'  hloek 

\  o  H  /  \  n  n  / 

elgenva hum  or  A. 

Definition  ».J  jU)  &  flmJ&te  SAk  £X  feiiUUi  UttmkMJLi  m 
al  Mum  U  ruMlx  amltmw.  u  ill  Ua  tJLtm&Uti  sxi 
tmijx  Hum  ax  &ml  la  Hut  sksii.'ulM  aC.  nul  aMrnx  &1»&K 
UitMilai  Xx  Hit  &»»um  m* 

The  construction  of  Theorem  8.3  can  be  done  euoh 
that  the  first  block  eigenvalue  contain*  the  n  iargsat  eigen- 
valuea  of  the  matrix.  We  thus  get  the  following  Important 
result  that  was  not  true  for  aolventa. 

Corollary  8.3  Every  blook  matrix  hea  |  complete  mjj.  ft£  black 

UttKYiiimi  Him  ant  at  Mum  mkl*  stimL Qtni« 

Blook  eigenvalue!  thue  far  oonaldered  have  all  been 
in  Jordan  form.  However,  unlike  aolventa,  any  matrix  similar 
to  a  blook  eigenvalue  la  also  a  block  eigenvalue.  This  fol¬ 
lows,  ainoe.  if  AV  •  VX  and  Y  •  P"'1XP,  then  A(VP)  »  (VP)Y, 
and  VP  la  still  of  full  rank. 

8, 3  Blook  VsQtor  Algebra.  We  now  consider  some  of  the  baaio 
properties  of  blook  eigenvalues. 

Definition  8.4  Blook  vectors .  vi»***»Vk  of  dimension  mn  b£  n, 

k 

S£1  XlSSJ?.  linearly  independent,  if  J  V1AJ  «  ft  jJBBliaa. 

1-1 
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idav.  6t  -  a  tin  kil  i »  ttJuuia  At  ah  mi\rl9t>  si  ais&i  ”• 


Note  thAt.  a  set  .of  block  vectors  belnR  block 
linearly  dependent.  do e*  not  imply  that  one  of  them  om  be 
solved  for  am  a  combination  of  the  others ,  since  All  the 
A^'n  may  b«  singular, 


Umm«  fl.l  1  m,  kl  Sill  felSSK  XJSlSI 

vi  *  (vil **  *  *  ,vin^ '  vi»***»vm  i£li  ttlSSU  iiatilil 

Andwtndmt  U  AHl  SLDlX  II  tVjj*  lai  1  -  !,•••, m» 

J  •  fuel  Uniitlx  InlvBindLiM  in  * 


mn 


Proof i  (1)  Assume  {v^}  Art  linearly  dependent.  Thus, 
there  exists  (a^j)  not  All  sero,  «uoh  that 

J]  aijvlj  "  A*  Let  Ai  b#  *  matrix  whose  first 
1J 

m 

oolumn  is  »  and  tho  remainder  of  the 


•in 


m 


matrix  is  zero.  Then  V^A^  ■  A  and  not  all 

i-1 

the  A^  « 

(ii)  Assume  {V^ }  are  blook  linearly  dependent. 

Thus,  there  exists  {A^}  not  all  zero  matrioes ,  suoh 
m 

that  2^  ViAl  “  Let  ^  b0  suoh  that  there  is  an 
i«l 

element  in  the  kfc^  oolumn  of  at  least  one  k^  that 

is  not  zero.  Then,  vij(Ai)  8ince  this  is 

lj  Jk 

m 

the  kth  column  of  ViAi  and,  since,  {v.^}  are 


linearly  dependent. 


# 
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Definition  8.*S  Block  vootora  of  dimension  mn  b£ 

n  A  blook  basin  if  for  any  V  of  the  game  dimension 

there  exists  a  unique  set  of  matrioes  A^ » *  * • ,Am  auoh  that 
m 

V  -  £  vr 
i-1 

Block  veotors  being  block  linearly  independent  and 
forming  a  blook  basis  are  related  by  the  following. 

Theorem  8 . 3  Blook  veotors  ,  • • • ,  Vm  of  dimension  mn  by  n 
form  a  blook  basis  if  and  only  if  they  are  blook  linearly 

UMt  ■avvwwnn  mm  iiiti aMMa  mmmm  aMMiaAt  — ■  •« m  —  a  W— 

independent. . 

Proof:  Let  V  be  a  blook  vector  of  dimension  mn  by  n. 

m  /aA 

V  ■  ]£)  ViAi  ls  equivalent  to  V  -  ( v1,  •  •  •  »Vm)(  ;  j. 

1-1  Vm/ 

The  matrix  is  square  and,  by  Lemma  8.1, 

nonsingular,  if  and  only  If  {V^ }  are  block  linearly 
Independent.  # 

A  generalization  of  a  matrix  with  distinct  eigen¬ 
values  being  similar  to  a  diagonal  matrix,  is  given  by  the 
next  result. 

Theorem  8.1!  rf  A  has  block  eigenvalues  with  block 

eigenvectors  • • ,Vm  that  are  block  linearly  independent, 
and  if  X  is  also  a  block  eigenvalue  of  A,  then  X  is  a  block 
eigenvalue  of  diag(X1,» • « ,Xm) .  Furthermore , 


(V. 


■V 


-1 


A(V- 


’V 


-  alag(X, 


•V 


(8.1) 
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Proof:  Equation  (8.1)  is  easily  verified.  Let  AV  -  VX. 
Then,  by  Theorem  8.3»  there  exists  a  unique  set 
of  n  by  n  matrices,  ai»‘***am*  8UCh  that 

ip 

V  -  £  A  "  (al***‘,am)  *  Thus» 

i-1 

V  ■  (V^,» • • ,Vm)A.  Since  (Vlt««*,Vm)  is  nonsingular 
and  V  is  of  full  rank,  by  definition,  it  follows 
that  A  is  of  full  rank.  Now,  using  equation  (8.1), 
we  get 


<Vl,-“»Vm)AX  "  vx  "  A(V*»VA 

“  <vi»,,*»vm>  <*iag(X1,f,Xm)A. 


Finally,  diag(X1,* • • ,Xm)A  -  AX  with  A  of  full 
rank .  # 


8.H  Block  Companion  Matrix.  An  application  of  the  block 
eigenvalue  problem  is  given  below.  We  again  consider  the 
block  companion  matrix.  Recall  that 


0 

I 


(8.2) 


and 
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where 


M(X)  =  Xn  +  A-,Xm""1  +  •••  +  A. 

jl  m 


(8.4) 


It  will  be  shown  that  a  solvent  is  a  block  eigen¬ 
value.  The  converse  is  not  true,  since  a  matrix  similar  to 
a  block  eigenvalue  is  also  a  block  eigenvalue,  but  the  same 
Is  not  true  of  solvents. 

The  following  is  easily  verified. 


then  S  is  a 


Unlike  the  scalar  eigenvalue  problem,  the  block 
eigenvalues,  with  respect  to  left  and  right  block  eigen¬ 
vectors,  are  different. 

Definition  8.6  An  n  bjr  n  matrix  Y  is  a  left  block  eigenvalue 
of  dimension  n  of  A ,  a  matrix  of  order  mn ,  if  there  exists  a 
block  vector  W  of  dimension  n  b^  mn  of  full  rank ,  such  that 
WA  *  YW.  W  is  a  left  block  eigenvector. 
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A  generalization  of  what  occurs  in  the  scalar  case, 
(see  Jenkins  and  Traub  [8]),  is  given  in  the  next  theorem. 

Theorem  8.6  If  H  1b  a  left  solvent  of  M(X),  then  R  Is  a 

B 

left  block  eigenvalue  of  C  ,  with  left  block  eigenvector 
(Dm-l***‘ where 

D(  X)  5  IX1"'1 +D,Xm”2  +  “•  +Dm  0X  +  D_  ,  5  (IX-R)“1M(X)  .  (8.5) 
x  m-  c  m—  jl 

Proof:  Let 

I 
A 

Multiplying  out,  we  get 


Consecutive  substitutions  yield 

Ym  +  Ym"1A1  +  •••  +YAm_1  +  Am  -  0.  Thus,  Y  -  R, 

i.  y. 

a  left  solvent  of  M(X).  Now,  multiply  the  i 
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equation  of  (8,6)  by  X1”1;  add;  let 
D ( X )  S  IX1"”1  +  +  •••  +  Dm-1;  and  get 

equation  (8.5),  # 


In  a  similar  manner,  we  find  that  if  S  is  a  right 
solvent  of  M(X),  then  S  is  a  block  eigenvalue  of  C,  with 


V 


m-1 


block  eigenvector 


where 


MUMIX-S)"1  =  IX1"”1  +  V-.x"1”2  +  +  V  ..  (8.7) 

l  m-i 

Let  be  a  left  solvent  of  M(X).  Then  by  equation 
(8.5)  and  Corollary  3.i|,  it  follows  that  M^X)  =  D^X),  if 
the  appropriate  block  Vandermondes  are  nonsingular.  Also,  hy 

equation  (3-12),  0^(8^)  ■  ,  which  is  the  inverse  of 

the  leading  matrix  coefficient  of  the  Ith  fundamental  matrix 
polynomial. 

Let 


I 


V 


i 


(8.8) 


and 
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W 


i 


l  m-i 


.D 


(i) 

1 


I 


(8.9) 


where  It  is  assumed  that  both  V(S,.***»S  )  and 

l  '  m 

V(S1,* • • ,Si_1 • • ,Sm)  are  nonsingular,  and  that 

■  A^^  SiA^1^  from  equation  (3.11). 

The  biorthogonality  of  right  and  left  block  eigen¬ 
vectors  is  given  by  the  following. 

Theorem  8.7  Under  the  above  assumptions 


wivj 


5 

SijAl 


-1 


(8.10) 


Proof: 


wivj 


( 


& 


•  •  • 


■  Dmii  +  SJ  +  "•  +  «T  “  D1(SJ> 

■  Di(Si)M1<3J)  -  f 

From  Theorem  8.5  and  Lemma  8.1  the  result  that 
V(S1,***,Sm)  is  nonsingular,  if  and  only  if  the  block  eigen- 

n 

vectors  of  C  are  block  linearly  independent,  is  easily 
obtained . 
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8.5  Algorithms  for  Block  Eigenvectors .  Consider  now  block 
powering  methods,  as  in  equations  (6.6)  and  (6.7).  Let 


(V)k  *  Vk,  where  V 


and  Is  an  n  by  n  matrix. 


Algorithm  3  Let 


U 


n+1 


(8.11) 


where  UQ  Is^  an  arbitrary  block  vector  of  full  rank  and 
1  1  k  <  m  is  an  arbitrary  fixed  Integer. 

The  normalization  in  equation  (8.11)  depends  upon 

the  nonsingularlty  of  (AUn)  • 

k 

Lemma  8.2  Un  -  . 

Proof: 

Vl  ■  AOn(K)k)’1 

■  A*un-l((Aun-l)k)’l((A2°n-l)k((AUn-l)k)"X) 

-  . An+1»0((An+\)k)'1-' 
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With  this  identity,  convergence  can  be  proved. 

Theorem  8.8  Let  be  a  complete  set  of  block  elgen~ 

values  of  A  with  block  eigenvectors  V^,»»*,Vm.  si  doml~ 

nates  all  the  other  block  eigenvalues  and  U0  is^  in  the  span 

m 

of  0^},  that  is  U0-2  V^,  and  “i  is  nonsingular,  then 

-1  1-1  -1 

Un+1  ‘  AUn((AUn)k)  e°^er-Se-8-  £°  Vl((Vl)fc)  *  H  (Vl)k  15. 

nonsingular. 

Proof : 


U 


n 


(*x xmj1 


m 


4-1 


ViSlai 


ViSial 


1-1 


m 


m 


-1 


a-i 


'l-i 


» 


as  n 


»,  by  Lemma  5.1*  Since,  as  shown  above, 

(AUn)  aIlsin  (vi)  »  follows  that  (AUn^  is 
k  k  k 

nonsingular  for  n  sufficiently  large  since 
exists  by  the  hypothesis. 


-1 

k 
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In  the  application  to  the  block  companion  matrix, 

the  existence  of  a  k  such  that  (V1  )  is  nonsingular,  is 

'  1/k 

equivalent  to  the  existence  of  a  solvent.  If  a  right  solvent 
exists,  k  can  be  taken  as  1  by  Theorem  8.5-  The  converse  13 
proved  below. 


Theorem  8.9  If  CBV  ■  VX  and  (V)^  is.  nonsingular,  then 
S  ■  (V).jX(V)”1  is  a  right  solvent. 


Proof: 


Let  V(V)”1 


D 


V(V)"1  is  a  block' 


rm  I 

eigenvector  of  C  with  block  eigenvalue1 
S  -  (V^XCV)"1.  Thus, 


Multiplication  yields  -  S1-1  and 

D  S  +  A,Dm  +  •••  +  k  ■  0.  Hence,  S  is 
m  1  m  m  * 

solvent . 

Thus,  Algorithm  3,  applied  to  the  block 


a  right 

ft 

companion 


matrix,  converges  to  a  block  eigenvector  associated  with  a 


~  fl6  - 


solvent.  Since  block  ©tganvalURn  always  exist  but  solvents 
do  not,  it  la  necessary  to  oonaldar  a  normal  1  Ration  which 
does  not  depend  on  the  existence  of  solvent*.  A  block  wlgwn- 
value  yields,  by  Corollary  8.1,  as  muoh  Information  to  the 
latent  root  problem  as  a  aolvent  does.  The  difficulty  Is 
that  a  deflation  of  the  form  M(X)  •  Q(X)(IX-8)  is  not 
available  for  block  eigenvalues. 

For  a  block  vector  Vj  of  full  rank,  let 

kJ 

denote  the  n  by  n  matrix  formed  by  taking  the  first  n  rowa  of 
Vj  that  are  linearly  Independent.  Aotually ,  the  rule  for 
choosing  the  n  linearly  independent  rowa  is  not  important, 
as  long  as  the  rule  yields  a  unique  set  of  rowa, 

Algorithm  Let 


Vi '  auj 


KJ 


(8.12) 


If  it  is  assumed  that  A  is  nontingular  and  UQ  is  of 
full  rank,  then  AUj  will  remain  of  full  rank,  and  the  itera~ 
tlon  (8.12)  will  always  be  defined.  It  is  the  goal  here  to 
get  Uj  to  converge  to  V^,  the  block  eigenvector  corresponding 
to  the  dominant  block  eigenvalue  of  A.  Since  the  dominant 
block  eigenvalue  cannot  be  singular,  it  follows  that  for  Uj 
close  to  Vx,  A  is  not  required  to  be  nonsingular  to  ensure 
that  the  normalization,  (8.12),  is  defined. 
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l.amma  fl.1  II |  •  A^ll 


Proof i 


V>  ‘  »"j  (*".i)k 


-iVl 


AVi  {(A?uj-.i)i 


.  # 


Lat  danota  the  n  by  n  matrix  formad  from  the 

firat  n  Unaarly  lndapandant  row#  of  Vj.  Convarganoa  of 
Algorithm  4  o#n  now  b#  provad  praoiialy,  as  in  Thaofam  8.8. 

Thwcram  8.10  Jgt  S1 , •  •  •  ,Sm  b$.  4  oompj&$i  fil*.  Sf.  fel2£&  Sl&iJlz 
21  A  yJ.SH  §±2.2.*  »lg»P,v>QtQra  II  S1  i9JHk. 

min  HI  iUa  9ih»r  Hsak  aimvaim  In  ib®  aii  aM  u0  Is.  In 

m 

iba  am  si  (vx).  aial.  Ii  u0  *  S  viai*  sM  M  mi 

1-1 

singular,  iba a  uJ+1  -  au^au^  \  oonvargaa  to  v1(v1)~1. 

J/  ^ 


CHAPTER  9 

MMirlsuti,  a*M iju. 


Right.  numerical  examples  follow.  All  calculations 
were  done  on  Cornell  University**  HIM  360/67  In  APT.,  Thin  la 
n  time -sharing  language  that  give*  the  numerical  analyst 
flexibility  in  designing  algorithms.  It  ha*  complete  matrix 
arithmetic  and  does  all  calculations  in  double  precision, 

l) .  1  Consider  the  monic  cubic  matrix  polynomial 


M(X)  •  X3  ♦ 


(■*  V  *  ( 1  "!V  *  f 18 

\-3  -15/  \21  65/  \-33  - 


66 

81. 


Algorithm  1  yields  for  stage  one 


ff0<X)  -  X% 


si<*>  *  *z  + 


5-(x)  •  x*  ♦ 


^<x>  -  x*  + 


■1.444 

1.111 

■1,821 

■1.490 


-0.667 
333 


2.222\  /-0.6 

-4.770/  \  2.; 

2'979V  ♦  (-1- 

-6.290/  \  3. 


-1.105 
432 


-1.956  3.356> 

-1.678  -6.989/ 


X  + 


..  /-2.008  3.574\  /- 1. 

5a(x)  -  +  [  x  + 

q  \-1.787  -7-  368/  \  4. 


-4.667 

6.333, 

-6.865> 


9.192j 


-1.394  -8.06T 


4.030  10.697, 


586  -8.762 
381  11.557 
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which  have  eigenvalues  5,6;  3*^  and  1,2,  respectively.  Thus, 

,'j  in  u  dominant  solvent.,  Furthermore,  VCS^Sg.S^)  and 
W(S2,S^)  are  nonsingular.  The  unique  monic  matrix  polynomial 
having  these  solvents,  which  was  obtained  using  Corollary  ^.3* 
is 


M(  X)  -  X3 


(-11.7910^78 
1.91044776 

/  42 . 3 4328358 
^-13.^3283582 


0.82089552\  2 

-9.20895522/ 

-10.16417910\ 

X 

25.6^17910^/ 


(-50.35820896 
19.58208955 


21.88059701 

-22.80597015 


The  corresponding  lambda-matrix  has  latent  roots  and  latent 
vectors 

Root  Vector 

1  (1,1. 5)T 

2  (1.1)T 

3  (1,-2)T 

H  (1,-1>T 

5  <1.-1)T 

6  (1,-.5)T 

From  these  results,  we  find  that  * 
solvent.  Its  eigenvalues  are  3  and  5  and,  hence,  it  yields 


is  also  a 
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only  redundant  Information  for  the  lambda-matrix  problem. 

Note  that  the  only  combination  of  latent  roots  that  cannot  be 
eigenvalues  of  a  solvent  are  4  and  5. 

For  this  problem 


p  /-5  7/9  1  4/9 \  /  8  7/9  -4  1/9  \ 

M,  (X)  ■  X*  +  (  X  + 

\  1  8/9  -4  2/9  /  \-3  8/9  4  5/9 


to  which  &  (X)  is  to  converge.  Letting  GQ(X)  •  X2,  we  get 


2  /"3.541  . 678  \ 

Q1(X)  -  X*  +  1  X  + 

1  V  .724  -2.644/ 


(4.183  -1. 

-1.259  2. 


-1.708 


52(x) 


X2  + 


-5.696  1. 407 \  /  8.566  -3.986 

,  1.759  -4.161/  V-3.553  4,357 


o3(x) 


X2  + 


-5-770 


1.876  -4.216 


1. 44l\ 
-4.PT6  / 


8.756  -4.099 


-3.854 


.099  \ 
.535/ 


The  ratio  of  the  leading  matrix  coefficients,  which  is  to 


converge  to  S 


>■(.:  :)• 


results  in 


"821 

v  A/\  \-1.910  9.209 


(«i°)K)' 


6.874  1.682 

-.877  4.308 
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6.983  1.966 

-.983  4.034 


Algorithm  2  which  yields  a  dominant  latent  root  was  shown  to 
be  obtainable  from  the  first  Btage  of  Algorithm  1.  The  iter¬ 
ation  for  this  problem  is 


Latent  Root  Estimate 

1  11.791044 

2  8.332911 

3  7.247455 

4  6.743387 

5  6.467439 

6  6.302969 

7  6.200093 

8  6.133848 

9  6.090399 

10  6.061549 

11  6.042225 

12  6.029191 

13  6.020346 

14  6.014309 

15  6.010162 

16  6.007294 

17  6.005296 

18  6.003892 

19  6.002895 

20  6.002181 

21  6.001663 

22  6.001283 

23  6.001000 

24  6.000787 

25  6.000626 

26  6.000501 

27  6.000404 

28  6.000327 

29  6.000267 

30  6.000218 


All  of  the  Iterations  thus  far  described  have  been 
linearly  convergent.  The  ratio  of  the  errors  has  been  .8, 
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which  ia  the  ratio  of  the  smallest  eigenvalue  of  the  dominant 
solvent  and  the  largest  of  the  next  dominant  solvent.  The 
second  sta^e  should  also  be  linear,  but  with  a  ratio  of 
errors  C(.8)^”^.  The  results  are 


10 


L  -  5 


Xo  - 


6.8738  1.6815 

,-.8769  4.3084 


C: 


9995  4.0011 


X4  " 


15 


7 

l-1 


6.8632  1,0039 

-.8216  4.9284 


8.3287  -.0258 

■1.2123  6.4868 


6.9766  1 .9515  \  /  6 . 8378  1. 5718  \  /  7 .0843  .5261 


-.9770  4.0475/  V-. 8495  4. 3918  /  \ -. 8895  5-3558, 


6.9963  l-9927\  /  6.9153  1. 8ll5\  /  6.8201  .8844^ 

-.9964  4.0072/  \-, 9215  4.1741/  \ -.8009  4.9547 


6.9994  1.9989  \  /  6.9602  1.9165  \  /  6.7670  1.1458' 


A- 


9630  4,0774  /  V-. 7878  4.7206, 


I  6.9999  1.9998\  /  6.9819  1.9630  W  6.7763  1.3414 
\-.9999  4.0002/  \ -.9832  4.0343  /  \ -.8043  4.5559 


2 

4 


7 

■1 


2 

4 


6.9790  1.9573' 

-.9819  4.0367, 


The  ratio  of  the  errors,  which  by  Corollary  5.2 
should  be  C(.8)^”^,  was  found  for  large  values  of  i  to  be 
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L 


Xi+1-Sl 


Xi“Si 


10 

8 

6 

4 

2 

1 


•  15 
.23 
.36 
.54 
.78 
.91 


This  shows  that  by  increasing  the  number  of  iterations  of 
stage  one,  stage  two  can  be  made  to  converge  more  rapidly. 

9.3  Consider  the  matrix  polynomial 


M(X) 


X2  + 


-11.44382802 
0.8613037448 


3.420249653 

-5-556171983 


X 


2 


/  41.02912621 
\  0.5533980583 


-20.93481276  \ 

X 

7.332871012/ 


/-39. 65603329 
\  0.6074895978 


23.56171983 

-3.386962552 


/  7  2  \ 

It  has  a  complete  set  of  solvents,  S,  ■  I  I  and 

1  \-l  4/ 

/  4  ~2\ 

SD  *  S,  «  (  1.  The  eigenvalues  of  S,  are  5  and  6,  while 

2  6  \3  -1/ 

while  the  eigenvalues  of  S2  are  1  and  2.  Clearly,  V(S^,S2, S^) 
and  V(S2,S^)  are  singular.  Algorithm  1  converged  for  all 
values  of  L.  With  L  ■  6,  we  get 

6.7783  1.2464 

-1.0231  3.9215 
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X1  " 


'  6.3896  1.9764 

-i.oon  3.9975 


6.9997  1.9995 

-1.0000  3.9999 


The  convergence  Is  fast,  though  linear,  since  the  asymptotic 
error  constant  is  ( . ^ ^ . 


9.4  Consider  the  problem 


M(  X)  -  X*  + 


1.6  -8.6 


-1  4  4. 4\  2  /  52.6  -29 


-10.4  22, 


-73.2  40.8 

16.8  -19.2 


/  7  2  \ 

This  problem  has  a  complete  set  of  solvents,  S,  ■(  , 

1  \-l  4  / 

S2*(_j  D'  a"d  S3’(o  D'  S!  domlnates'  V(S1-S2*S3) 


is  nonsingular,  and  V(S2,S^)  is  singular.  M^X)  exists 
uniquely,  but  its  leading  matrix  coefficient  is  singular. 
Hence  lim  EF(X)  does  not  exist.  However,  Algorithm  1  con- 

n-v«o  n 

verged.  This  is  because  the  second  stage  needs  the  ratio  of 
0L(X)  and  not  For  this  type  of  problem,  the 

equation  XQ  *  can  cause  difficulties  because 

can  become  singular.  For  this  problem,  however,  the 
ratio  did  exist  since  did  not  quite  become  singular. 

If  it  had,  a  random  XQ  would  have  been  used.  After  twenty 
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iterations  of  the  first  stage. 


Then, 


Xo  " 


X1  " 


x3  - 


5.0260  -2.0376 

-.5065  5.0094 


1 5. 1741 

-1.6544 

\-.5435 

4.9136 

/ 6.6745 

1.3489 

\-.9l86 

4.1628 

/6 . 9929 

1.9857 

V-.9982 

4.0036 

9.5  Consider  the  quadratic 


M( X)  -  X*  + 


:  :)■*( 


9  3 
4  4 


The  corresponding  lambda-matrix  has  latent  roots  -16,05113, 
-.4215  and  -.26 37*  1.86491,  There  exist  two  solvents  having 
these  as  their  eigenvalues,  but  neither  can  dominate,  since 
there  is  a  complex  pair  of  latent  roots  whose  absolute  value 
is  between  the  two  other  latent  roots.  Algorithm  1  did  not 
converge,  but  Algorithm  2,  whose  computations  are  done  by 
Algorithm  1,  did  converge  to  yield  the  dominant  latent  root, 
-16.05113.  The  order  of  the  matrix  coefficients  was  then 
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reversed  and  the  minimum  latent  root  was  found.  Using  these 
results,  a  solvent  was  formed,  deflated,  and  the  new  problem 
yielded  a  solvent  with  eigenvalues  which  were  the  remaining 
complete  pair  of  latent  roots.  This  problem  suggests  the 
use  of  a  random  complex  shift  of  the  variable  in  the  lambda- 
matrix.  This  will  break  up  troublesome  complex  pairs  of 
latent  roots.  With  a  shift  of  i.  Algorithm  1  converged  with 
no  difficulties.  All  computations  were  done  in  the  complex 
domain . 

9.6  Consider  the  quadratic 

2  A 1 

M(X)  -  X*  + 


The  corresponding  lambda-matrix  has  latent  roots  1,2, 3,4  with 
corresponding  latent  vectors  (1,0)T,  (0,1)T,  (1,1)T,  (1,1)7. 

(1  2\ 

The  problem  has  a  complete  set  of  solvents  S.  ■  I  ]  and 

\0  3/ 

A  °\ 

S-  ■  1  ]  .  Other  solvents  have  eigenvalues  1,2;  1,4  and 

*  VO  2  / 

2,3.  The  only  pair  which  cannot  be  the  eigenvalues  of  a  sol¬ 
vent  is  3,4.  Thus,  no  dominant  solvent  exists  and  Algorithm 
1  did  not  converge.  However,  Algorithm  2,  as  computed  by 
Algorithm  1,  yielded  the  dominant  latent  root,  4. 

Reversing  the  order  of  matrix  coefficients  has  the 
effect  of  making  the  latent  roots  the  reciprocals  of  the 
original  latent  roots.  The  right  solvents  are  the  inverse  of 
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the  original  ones.  Thus,  i  and  ^  ere  the  new  dominant  latent 


rooto.  Algorithm  l  converged  to 
/l  0\ 


advent 


CD 


n  o\ 

)  .  and, 

\0  >»/ 


ha no a,  the 


was  found  for  the  original  problem.  Note  that 


for  the  problem  for  whloh  Algorithm  1  did  oonverge,  there  wan 
no  complete  sot  of  advents  whloh  lnoluded  the  dominant  sol 


vent 


*  °). 

0  \J 


9.7  Lancaster  considers  a  test  problem  whloh  "depends  on  a 
parameter  whose  value  determines  the  proximity  of  oluatered 
roots"  [13i  p.  90].  Consider  M(X)  ■  X2  +  A^X  +  Ap,  where 


■(  l+a2+202 ) 


ad+afi^) 


-02(a2+82) 


A1  - 


-l+2a 


a-a(a2+202) 

-(a2+2B2) 


2  a2B2 


-ae2(a2+02) 

-02(a2+02) 


where  0  -  a  +  1.  The  eight  latent  roots  of  M(A)  are 


*  QU  • 


0  . 

♦  t 
•*« 

* ( 14rt  )  t  , 

Aiut  • 

Algorithm  l  wan  t,®at,®rt,  and  woi*t,®0  for  u  •  \  «n*l 

,001.  Whtn  «  1*  mad®  amall,  th®  «man®at.  *tg®nvalu*  *>r  ih® 
dominant  aolvant  approach**  th®  larg®«t  «i**nvalu@  of  th* 
n«xt  aolvtnt.  Thui ,  oonv®rg*no«  1*  eunaldarably  «low*r  for 
amalltr  a.  Uain*  th®  eod«  In  Appamlix  R»  th*  raaulta  war® 


a 

Ji. 

it ®r at Iona 

II  MIX,)  || 

$ 
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3 
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10 

9 
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10 

9 
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98 

7 
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.001 

30 
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9,8  Finally,  oonaldar  th®  intriguing  probl®m 


Not®  that 


/'  °\ 

;>  j  -  ^  J  tw  «  dominant  solvent,  but  tv  oan  be  shown  thnt 


there  U  no  corresponding  3^  thnt  would  form  a  complete  net 
of  solvent*.  hut  Unit  0o  ( X )  •  X,  we  gel 


tout 


With 


It  is  eaaily  seen  thnt  ♦j(X)  «  for  nil  X  auoh  thnt 
/I  1\  n  7\ 

X  -  I  I  la  noneingulnr.  Thus,  the  exact  oolutlon 
Vi?  2/  \0  0/ 

la  obtained  In  one  Iteration  of  stage  two  for  any  X 
satisfying  this  one  easy  condition. 


APPENDIX  A 


Mmm is. 

Thlti  paper  has  oonaidored  only  matrix  polynomials 
(ami  lambda- met r loon ) ,  where  the  Identity  matrix  was  the 
leading  matrix  coefficient.  Consider  now,  tha  matrix 
polynomial 

M( X)  ft  AQXm  +  A^Xm“^  +  ♦  Am.  (A.l) 

If  A0  la  nonaingular,  than  R(X)  s  A'^MCX)  la  tha  problem 
that  is  dealt  with  in  tha  body  of  this  paper.  If  R  Is  a  left 
solvent  of  M(X),  tha  K  ■  A“1RAq  lo  a  left  solvent  of  R(X). 

Tha  case  where  AQ  is  singular  presents  soma  diffi¬ 
culty  in  the  matrix  polynomial  problem.  Franklin  [1]  oon- 

/I  0\  2  /0  2 \  /0  0  \ 

aiders  the  problem  M(X)  •  (  )  X*  ♦  f  X  ♦  [  J ■  0, 

\0  0/  \  3  0/  '0  6/ 

/°  «2\ 

which  has  a  solvent  (  I  for  all  values  of  &  and  b .  Thus , 

a  matrix  polynomial  with  both  An  and  Am  singular  oan  have 

solutions  with  variable  eigenvalues. 

If  k  is  nonsingular  then 
m 

MR(X)  =  AmXm  +  Ain-tlXm”1  +  +  Aq  (A. 2) 

can  be  used.  The  solvents  of  M  (X)  are  the  inverses  of  the 
solvents  of  M(X).  M(X)  does  not  have  any  singular  solvents 

D 

since  Am  is  nonsingular.  However,  if  M  (X)  has  a  complete 
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10? 


wot  of  solvents,  then  one  of  them  must  be  singular,  since 

D 

«oro  ia  a  Intent  root  of  M  (X).  Thla  follows  since 

(let  MK(0)  -  (let  A  -  0. 

o 

In  contrast  to  the  matrix  polynomial  problem,  the 
latent  roots  of  the  lambda-matrix  problem 

MU)  s  A0Xm  +  A1Xm“1  *■•••♦  Am  (A.  3) 

can  be  oaloulated,  even  if  AQ  is  singular.  If  Am  is  singular, 
then  X  »  0  is  a  latent  root  of  M(X).  If  o  is  not  a  latent 
root  of  M( X ) ,  then  Am(a)  is  nonsingular,  where 

MQ(X)  3  M( X+o )  £  A0(o)Xm  +  •••  +  Am(c).  (A. 4) 

Furthermore,  if  p  0  is  a  latent  root  of  M(X),  then  1/p 
ia  a  latent  root  of 

MR(X)  =  Xm  s  A  Xm  +  A  t  X^1  +  •••  +  A  .  (A.  5) 

V  x  /  m  m- 1  o 

If  M  (X)  has  a  zero  latent  root  (AQ  is  singular),  then  M(X) 

is  said  to  have  an  unbounded  latent  root.  A  lambda-matrix 

M(X)  is  said  to  be  degenerate  if  det  M(X)  -  0  for  all  X, 

This  can  only  occur  if  A„  and  A^,  are  singular. 

cm 

Consider  the  following  algorithm  for  a  non¬ 
degenerate  lambda-matrix.  It  transforms  a  lambda-matrix 
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with  a  singular  leading  matrix  coefficient  into  one  which  io 
not.  The  trnnoformod  lambda-matrix  in  wither 

(i)  MR(X)  if  Am  la  nonaingular 

or  (ii)  MS(X)  s  Xm  M^y  +  o'j,  where  det  M(c)  ?  0. 

Part  (ii)  works  since  X^^y^  ■  M(X+c),  which  does  not 
have  a  zero  latent  root . 


APPENDIX  B 


Previously  Known  Methods  for  Lamhda-Matrloes 


The  determinant  of  a  lambda-matrix  Is  a  scalar 

polynomial.  Let  f(X)  -  det  M(X).  If  one  Is  willing  to 

evaluate  the  determinant  many  times,  then  one  can  use  any 

of  a  number  of  algorithms  for  the  zeros  of  a  scalar  function 

Tarnove  [19]  considers  the  use  of  Muller’s  method.  He  de- 

P-l 

flates  known  roots  by  considering  fp(X)  -  f ( X )  [f  (X-X^""1 

1-1 


Lancaster  [10]  notes  that 

f'(X)  -  f  (  X)Trac.e{M“’1(X)M’ ( X)  >  ,  which  he  uses  in  Newton's 
method.  Newton’s  method  is  also  used  by  Kublanovskaya  [9], 
who  finds  f(X1)/f'(Xi)  by  using  a  factorization  of  MCX^. 

Another  approach  analyzed  by  Lancaster  [12]  is  the 
use  of  a  power-like  method  with  a  generalized  Rayleigh 
quotient.  That  is,  for  arbitrary  nQ  and  XQ,  let 

q  -  [M(X1)]“1?0,  -  [mT(X1>]  1nQ,  and 


hTm(X. )£. 

L -  X.  -  — k - =■ — =—  .  Lancaster  has  shown  that,  for  a 

1  +  1  1 

class  of  lambda-matrices,  this  iterative  process  is  locally 
convergent  and  quadratic.  Modifications  of  the  above  algo¬ 
rithm  by  ^  -  [M(  Xi)  ]"15i<_1,  -  ^(X^j  ni_l  has  also 

been  considered  by  Lancaster. 
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Another  approach,  due  to  Lancaster  [1*1],  is  to 
consider  the  eigenvalues  of  M(X).  Let  p(X)  be  a  scalar  such 
that  M(X)  -  u ( X ) I  is  singular.  Then  a  ocalar  p  la  needed 
such  that  y(p)  *  0.  Lancaster  considers  Newton’s  method 
on  u( X ) . 

The  above  methods  of  Lancaster  and  Kublanovskaya 
are  only  locally  convergent  and  they  do  not  have  a  method  of 
deflation  associated  with  them. 

A  symbol-manipulation  approach  is  to  perform 
Gaussian  elimination  on  the  lambda-matrix  using  polynomials 
in  the  computations.  That  is,  every  non-trivial  lambda- 
matrix  with  det  Aq  /  0  can  be  transformed,  by  elementary 
transformations  only,  into  a  form  such  that 
M( X )  -  P(X)N(X)Q(X),  where  det  P ( X >  -  c],  t  0, 
det  Q(X)  ■  c2  /  0  and  N(X)  *  diag^a^X)  ,•  •  *  ,an(X))  ,  with 
a^X)  monic  polynomials  and  a^X)  divides  ai+1(X).  N(X)  is 
called  the  Smith  canonical  form  of  M(X).  See  Wilkinson  [22, 
p.  19],  Then  all  the  roots  of  the  a^CX^s  are  latent  roots 
of  M( X) . 

This  method  parallels  the  approach  of  finding  the 
characteristic  equation  in  the  eigenvalue  problem. 


APPENDIX  C 


The  Quadratic  Matrix  Polynomial 
The  monic,  quadratic  matrix  polynomial. 


M( X)  =  X2  +  AXX  +  A2, 


(C.l) 


with  right  solvents  and  S2,  is  of  the  general  form 

m(x)  *  x2  -  [s1 +  (s1-s2)s2(s1-s2)~1]x  +  (s1-s2)s2(s1-s2)”1s1 

(C.2) 

if  det  V(S-j,,S2)  *  det  (S2-S1)  /  0.  Note  that  if  S.^  and  S2 
commute,  then 

M(X)  -  X2  -  (S1+S2)X  +  (C.  3) 


even  if  V(S1,S2)  is  singular. 

The  corresponding  lambda-matrix  can  be  factored  as 

M ( A )  *  (iA  -  (S1-S2)S2(S1-S2)-1)(IA-S1) 

*  (iA-  (S1-S2)S1(S1-S2)“1)(IA-S2) .  (C.4) 


Thus  , 


R2  "  <S1-S2)S2(S1-S2) 


(C.5) 
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and 

Ri  “  (s1-s2)s1(s1-s2)'1  (C.6) 

are  left  solvents  of  M(X).  Prom  equation  (C.5)  It  follows 
that 

s2  -  sj  -  (s1+r2)(s2-s1) .  (C.7) 

Furthermore,  -A1  “  R2  +  S1  “  R1  +  S2  and  «  R2S1  *  R1S2* 
It  is  easily  verified  that 


I  \/l 


-Al/\S1 


°\/Sl  1 


i/Vo 


(C .  8) 


and  hence,  the  block  companion  matrix  is  similar  to 

regardless  of  V(S^,S2)_ 

Assume  that  A^  and  A2  are  real  matrices  and  let 
+  iS^  be  a  right  solvent.  Then, 


M(A  )  s 


+  A^A 


^IA-^+iR°^IA-^+iS^y  (C  .9 ) 


Equating  coefficients,  we  get  R2  +  S°  ■  0  and  R^S^  +  R^S^-O. 
Then,  R2R2 + •  0,  By  direct  substitution  it  now  follows 
that  S£  -  1S^  is  also  a  right  solvent.  Thus, 
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Theorem  C.l  For  a  real ,  monlc  and  quadratic  matrix  poly¬ 
nomial  .  if  S  +  1C  a  right  solvent ,  then 
(1)  S  -  1C  is  a  right  solvent  , 

(11)  R  -  1C  Is  a  left  solvent ,  and 

(ill)  R  +  1C  is  a  left  solvent . 

where  R  +  S  =  -A^. 

Given  arbitrary  matrices  and  S 2,  Corollary  *1.1 
shows  that  there  might  not  be  a  monlc,  quadratic  matrix  poly¬ 
nomial  having  them  as  solvents.  Such  a  condition  occurs  if 
S-^  and  S2  have  distinct  and  disjoint  eigenvalues  and  if 
det  V(S1,S2)  a  0.  If  V(S1,S2)  is  nonsingular,  then  M(X) 
always  exists.  The  following  result  gives  necessary  and 
sufficient  conditions  for  the  existence  of  M(X) . 

Theorem  C.2  There  exists  a  matrix  polynomial 

M( X)  =  X2  +  A^X  +  A2  having  right  solvents  and  S2  if  and 

only  if  there  exists  a  solution  Y  of 

y(s2-s1)  -  (s2-s2).  (C.10) 

Proof:  In  finding  A^  and  A2  to  satisfy 

M(S1)  »  S2  +  A1S1  +  A2  -  £ 

M(S2)  *  s2  +  AxS2  +  A2  «=  0  (C.ll) 

the  matrix  A^  must  satisfy  ai^S2"1<51^  "  (S2-Sl)'  ^ 
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Note  that  If  V(S^,S2)  Is  singular  and  the  condi 
tlon  of  Theorem  C.2  is  satisfied,  then  M(X)  exists,  but  i 
not  unique.  Prom  equation  (C.10)  if  follows  that 


Corollary  C.l  If  (S2-S^)  is  singular  and  is_  non- 

f  singular ,  then  there  is  no  monlc ,  quadratic  matrix  poly- 

nomials  having  S,  and  as  right  solvents. 


Al'PKNDl  X  P 


Computer  Programs 

The  computer  program  that  wan  uaed  for  Algorithm  1 
follows.  It  Is  written  In  APL  for  the  IBM  360/67,  It  la  on 
Interactive  language  and  the  program  aaka  for 

(1)  the  degree  of  the  ma^'lx  polynomial, 

(11)  the  dimension  of  the  matrix  ooef fi  dents , 

(111)  the  matrix  polynomial, 

and  (lv)  the  stopping  criterion  (an  e  such  that  ||M(X,)||  <  e 
terminates  the  computation). 

Following  the  code  is  an  actual  output  for  Example  1 
in  Chapti  r  9. 
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